journal article·2024Open access

Abnormal Action Recognition with Lightweight Pose Estimation Network in Electric Power Training Scene

Yunfeng Cai, Ran Qin, Jin Tang, Long Zhang, Xiaotian Bi, Qing Yang

Computers, Materials & Continua· Volume 79· Issue 3

Abstract

Electric power training is essential for ensuring the safety and reliability of the system. In this study, we introduce a novel Abnormal Action Recognition (AAR) system that utilizes a Lightweight Pose Estimation Network (LPEN) to efficiently and effectively detect abnormal fall-down and trespass incidents in electric power training scenarios. The LPEN network, comprising three stages—MobileNet, Initial Stage, and Refinement Stage—is employed to swiftly extract image features, detect human key points, and refine them for accurate analysis. Subsequently, a Poseaware Action Analysis Module (PAAM) captures the positional coordinates of human skeletal points in each frame. Finally, an Abnormal Action Inference Module (AAIM) evaluates whether abnormal fall-down or unauthorized trespass behavior is occurring. For fall-down recognition, three criteria—falling speed, main angles of skeletal points, and the person’s bounding box—are considered. To identify unauthorized trespass, emphasis is placed on the position of the ankles. Extensive experiments validate the effectiveness and efficiency of the proposed system in ensuring the safety and reliability of electric power training.
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Human Pose and Action Recognition · Anomaly Detection Techniques and Applications · Hand Gesture Recognition Systems

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (45)

Show source-provided references
1. Review of medium-voltage switchgear fault detection in a condition-based monitoring system by using deep learning10.3390/en15186762 ↗
2. A review of foreign object detection (FOD) for inductive power transfersystems
3. Increasing the thermal efficiency of an operational data center using cold aisle containment
4. A Web-based virtual environment for operator training
5. A review of computer vision-based structural health monitoring at local and global levels10.1177/1475921720935585 ↗
6. 2D human pose estimation: New benchmark and state of the art analysis
7. Pose estimation from corresponding point data
8. Vision-based hand pose estimation: A review10.1016/j.cviu.2006.10.012 ↗
9. Graph-PCNN: Two stage human pose estimation with graph pose refinement
10. A survey of convolutional neural networks: Analysis, applications, and prospects10.1109/TNNLS.2021.3084827 ↗
11. Deep learning-based human pose estimation: A survey10.1145/3603618 ↗
12. Real-time upper body detection and 3D pose estimation in monoscopic images
13. Single-network whole-body pose estimation
14. 3D human pose estimation with 2D marginal heatmaps
15. DeepPose: Human pose estimation via deep neural networks
16. Joint training of a convolutional network and a graphical model for human pose estimation
17. Convolutional pose machines
18. Stacked hourglass networks for human pose estimation
19. Multi-context attention for human pose estimation
20. Rethinking the heatmap regression for bottom-up human pose estimation
21. The devil is in the details: Delving into unbiased data processing for human pose estimation
22. EfficientPose: Scalable single-person pose estimation10.1007/s10489-020-01918-7 ↗
23. RMPE: Regional multi-person pose estimation
24. Cascaded pyramid network for multi-person pose estimation
25. Simple baselines for human pose estimation and tracking
26. Top-down human pose estimation with depth images and domain adaptation
27. DeepCut: Joint subset partition and labeling for multi-person pose estimation
28. DeeperCut: A deeper, stronger, and faster multi-person pose estimation model
29. Associative embedding: End-to-end learning for joint detection and grouping
30. Realtime multi-person 2D pose estimation using part affinity fields
31. PIFPAF: Composite fields for human pose estimation
32. HigherHRNet: Scale-aware representation learning for bottom-up human pose estimation
33. LitePose: Efficient architecture design for 2D human pose estimation
34. Deep learning based 2D human pose estimation: A survey10.26599/TST.2018.9010100 ↗
35. Outlier detection for high dimensional data
36. Efficient algorithms for mining outliers from large data sets
37. Motion pattern study and analysis from video monitoring trajectory10.1587/transinf.E97.D.1574 ↗
38. Trajectory clustering: A partition-and-group framework
39. Density-based trajectory outlier detection algorithm10.1109/JSEE.2013.00042 ↗
40. Action recognition with improved trajectories
41. Spatio-temporal data mining: A survey of problems and methods10.1145/3161602 ↗
42. Attention-based LSTM network for action recognition in sports10.2352/ISSN.2470-1173.2021.6.IRIACV-302 ↗
43. Motion-shape-based deep learning approach for divergence behavior detection in high-density crowd10.1007/s00371-021-02088-4 ↗
44. Learning trajectory patterns by clustering: Experimental studies and comparative evaluation
45. Thin MobileNet: An enhanced MobileNet architecture