journal article·2023Open access

Human Verification over Activity Analysis via Deep Data Mining

Kumar Abhishek, Sheikh Badar ud din Tahir

Computers, Materials & Continua· Volume 75· Issue 1

Abstract

Human verification and activity analysis (HVAA) are primarily employed to observe, track, and monitor human motion patterns using red-green-blue (RGB) images and videos. Interpreting human interaction using RGB images is one of the most complex machine learning tasks in recent times. Numerous models rely on various parameters, such as the detection rate, position, and direction of human body components in RGB images. This paper presents robust human activity analysis for event recognition via the extraction of contextual intelligence-based features. To use human interaction image sequences as input data, we first perform a few denoising steps. Then, human-to-human analyses are employed to deliver more precise results. This phase follows feature engineering techniques, including diverse feature selection. Next, we used the graph mining method for feature optimization and AdaBoost for classification. We tested our proposed HVAA model on two benchmark datasets. The testing of the proposed HVAA system exhibited a mean accuracy of 92.15% for the Sport Videos in the Wild (SVW) dataset. The second benchmark dataset, UT-interaction, had a mean accuracy of 92.83%. Therefore, these results demonstrated a better recognition rate and outperformed other novel techniques in body part tracking and event detection. The proposed HVAA system can be utilized in numerous real-world applications including, healthcare, surveillance, task monitoring, atomic actions, gesture and posture analysis.
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Human Pose and Action Recognition · Video Surveillance and Tracking Methods · Anomaly Detection Techniques and Applications

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (38)

Show source-provided references
1. Security enhancement of hill cipher by using non-square matrix approach
2. S. B. ud din Tahir, “A triaxial inertial devices for stochastic life-log monitoring via augmented-signal and a hierarchical recognizer,” Doctoral Dissertation, M.S. Thesis, Dept. Computer science, Air University, Islamabad, Pakistan, 2020.
3. Syntactic model-based human body 3D reconstruction and event classification via association based features mining and deep learning10.7717/peerj-cs.764 ↗
4. D. Bhargavi, E. P. Coyotl and S. Gholami, “Knock, knock. Who’s there?–Identifying football player jersey numbers with synthetic data,” arXiv preprint arXiv:2203.00734, 2022.
5. Tracking pedestrians using local spatio-temporal motion patterns in extremely crowded scenes10.1109/TPAMI.2011.173 ↗
6. You don’t need labeled data for open-book question answering10.3390/app12010111 ↗
7. Salient segmentation based object detection and recognition using hybrid genetic transform
8. Stochastic recognition of human physical activities via augmented feature descriptors and random forest model10.3390/s22176632 ↗
9. RGB-D images for object segmentation, localization and recognition in indoor scenes using feature descriptor and hough voting
10. Spatio-temporal texture modelling for real-time crowd anomaly detection10.1016/j.cviu.2015.08.010 ↗
11. Adaptive pose estimation for gait event detection using context-aware model and hierarchical optimization
12. Attention-based convolutional neural network for weakly labeled human activities’ recognition with wearable sensors10.1109/JSEN.2019.2917225 ↗
13. Abnormal event detection in surveillance videos based on low-rank and compact coefficient dictionary learning10.1016/j.patcog.2020.107355 ↗
14. Human activity recognition based on improved Bayesian convolution network to analyze health care data using wearable IoT device10.1109/ACCESS.2020.2992584 ↗
15. An evaluation of pose estimation in video of traditional martial arts presentation
16. Stacked hourglass networks for human pose estimation
17. Cascaded pyramid network for multi-person pose estimation
18. Frame-level event detection in athletics videos with pose-based convolutional sequence networks
19. A Real-time physical therapy visualization strategy to improve unsupervised patient rehabilitation
20. Anomaly detection in videos for video surveillance applications using neural networks
21. Mishra · Recent Findings in Intelligent Computing Techniques · 2018 · 39910.1007/978-981-10-8636-6_41 ↗
22. Multiple events detection using context-intelligence features10.32604/iasc.2022.025013 ↗
23. The effects of particle swarm optimisation and genetic algorithm on ANN results in predicting pile bearing capacity10.1504/IJHM.2020.105484 ↗
24. Human motion retrieval based on statistical learning and Bayesian fusion10.1371/journal.pone.0164610 ↗
25. Graph mining: Laws, generators, and algorithms10.1145/1132952.1132954 ↗
26. Improved boosting algorithms using confidence-rated predictions10.1023/A:1007614523901 ↗
27. Sports videos in the wild (SVW): A video dataset for sports analysis
28. Ryoo · Recognizing Patterns in Signals, Speech, Images and Videos · 2010 · 27010.1007/978-3-642-17711-8_28 ↗
29. Pose estimation and detection for event recognition using sense-aware features and adaboost classifier
30. Segmentation and tracking of interacting human body parts under occlusion and shadowing
31. 3D human pose estimation from monocular images with deep convolutional neural network
32. Moving human full body and body parts detection, tracking, and applications on human activity estimation, walking pattern and face recognition
33. Action anticipation by predicting future dynamic images
34. A comprehensive solution for detecting events in complex surveillance videos10.1007/s11042-018-6163-6 ↗
35. Action recognition using hybrid feature descriptor and VLAD video encoding
36. Combined convolutional neural network for event recognition
37. Supervised framework for automatic recognition and retrieval of interaction: A framework for classification and retrieving videos with similar human interactions10.1049/iet-cvi.2015.0189 ↗
38. Optical flow guided feature: A fast and robust motion representation for video action recognition