journal article·2022Open access

Automatic Unusual Activities Recognition Using Deep Learning in Academia

Muhammad Ramzan, Adnan Abid, Shahid Mahmood Awan

Computers, Materials & Continua· Volume 70· Issue 1

Abstract

In the current era, automatic surveillance has become an active research problem due to its vast real-world applications, particularly for maintaining law and order. A continuous manual monitoring of human activities is a tedious task. The use of cameras and automatic detection of unusual surveillance activity has been growing exponentially over the last few years. Various computer vision techniques have been applied for observation and surveillance of real-world activities. This research study focuses on detecting and recognizing unusual activities in an academic situation such as examination halls, which may help the invigilators observe and restrict the students from cheating or using unfair means. To the best of our knowledge, this is the first research work in this area that develops a dataset for unusual activities in the examination and proposes a deep learning model to detect those unusual activities. The proposed model has been named Automatic Unusual Activity Recognition (AUAR), which employs motion-based frame extraction approaches to extract key-frames and then applies advanced deep learning Convolutional Neural Network algorithm with diverse configurations. The evaluation using standard performance measures confirm that the AUAR model outperforms the already proposed approaches for unusual activity recognition. Apart from evaluating the proposed model on the examination dataset, we also apply AUAR on Violent and Movies datasets, widely used in the relevant literature to detect suspicious activities. The results reveal that AUAR performs well on various data sets compared to existing state-of-the-art models.
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Anomaly Detection Techniques and Applications · Human Pose and Action Recognition · Occupational Health and Safety Research

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (43)

Show source-provided references
1. Intelligent health monitoring system modeling based on machine learning and agent technology10.3233/MGS-200329 ↗
2. Automatic accident detection with multi-modal alert system implementation for ITS10.1016/j.vehcom.2015.11.001 ↗
3. Big data platform of traffic violation detection system: Identifying the risky behaviors of vehicle drivers10.1007/s11042-020-09099-8 ↗
4. A survey on state-of-the-art drowsiness detection techniques10.1109/ACCESS.2019.2914373 ↗
5. Internet of medical things for smart D3S to enable road safety10.1177/1550147719864883 ↗
6. Prediction of future terrorist activities using deep neural networks10.1155/2020/1373087 ↗
7. A review on state-of-the-art violence detection techniques10.1109/ACCESS.2019.2932114 ↗
8. Cheating video description based on sequences of gestures
9. A comprehensive review on handcrafted and learning-based action representation approaches for human activity recognition10.3390/app7010110 ↗
10. Harris corner detector and blob analysis featuers in human activty recognetion
11. A review on video-based human activity recognition
12. Fuzzy logic based human activity recognition in video surveillance applications10.1007/978-3-319-29504-6_23 ↗
13. Human action recognition using trajectory-based representation10.1016/j.eij.2015.05.002 ↗
14. Hierarchical human activity recognition using neural networks
15. Depth images-based human detection, tracking and activity recognition using spatiotemporal features and modified HMM10.5370/JEET.2016.11.6.1857 ↗
16. A survey of vision-based human action evaluation methods10.3390/s19194129 ↗
17. A suspicious behaviour detection using a context space model for smart surveillance systems10.1016/j.cviu.2011.10.001 ↗
18. Roy · Advances in Soft Computing and Machine Learning in Image Processing, · 2018 · 730 · 27710.1007/978-3-319-63754-9_13 ↗
19. Fuzzy logic based human activity recognition in video surveillance applications10.1007/978-3-319-29504-6_23 ↗
20. Trajectory-based human activity recognition from videos
21. HHAR-net: Hierarchical human activity recognition using neural networks
22. A multi-index examination cheating detection method based on neural network
23. A robust human activity recognition system using smartphone sensors and deep learning10.1016/j.future.2017.11.029 ↗
24. Deep-anomaly: Fully convolutional neural network for fast anomaly detection in crowded scenes10.1016/j.cviu.2018.02.006 ↗
25. Action recognition in videos with temporal segments fusions
26. Vision-based human activity recognition: A survey10.1007/s11042-020-09004-3 ↗
27. Combining deep and handcrafted image features for presentation attack detection in face recognition systems using visible-light camera sensors10.3390/s18030699 ↗
28. Senthilkumar · Computational Intelligence, Cyber Security and Computational Models · 2015 · 99
29. Anomaly detection based on spatio-temporal sparse representation and visual attention analysis10.1007/s11042-015-3199-8 ↗
30. Activity recognition and anomaly detection in smart homes10.1016/j.neucom.2020.10.102 ↗
31. Patient monitoring by abnormal human activity recognition based on CNN architecture10.3390/electronics9121993 ↗
32. Iqbal · Handbook of Multimedia Information Security: Techniques and Applications · 2019 · 431
33. Harris corner detector and blob analysis featuers in human activty recognetion
34. Automated video surveillance system for detection of suspicious activities during academic offline examination
35. Deep-cascade: Cascading 3D deep neural networks for fast anomaly detection and localization in crowded scenes10.1109/TIP.2017.2670780 ↗
36. Human activity recognition from body sensor data using deep learning10.1007/s10916-018-0948-z ↗
37. Multi-features descriptors for human activity tracking and recognition in Indoor-outdoor environments
38. An algorithm of key-frame extraction based on adaptive threshold detection of multi-features
39. Stochastic pooling for regularization of deep convolutional neural networks
40. 3D Convolutional neural networks for human action recognition10.1109/TPAMI.2012.59 ↗
41. Correlational convolutional LSTM for human action recognition10.1016/j.neucom.2018.10.095 ↗
42. Action recognition based on sequential 2D-CNN for surveillance systems
43. Violence detection in crowded scenes using substantial derivative