Novel Hand Gesture Alert System
Source abstract
Abstract
Sexual assault can cause great societal damage, with negative socio-economic, mental, sexual, physical and reproductive consequences. According to the Eurostat, the number of crimes increased in the European Union between 2008 and 2016. However, despite the increase in security tools such as cameras, it is usually difficult to know if an individual is subject to an assault based on his or her posture. Hand gestures are seen by many as the natural means of nonverbal communication when interacting with a computer, and a considerable amount of research has been performed. In addition, the identifiable hand placement characteristics provided by modern inexpensive commercial depth cameras can be used in a variety of gesture recognition-based systems, particularly for human-machine interactions. This paper introduces a novel gesture alert system that uses a combination of Convolution Neural Networks (CNNs). The overall system can be subdivided into three main parts: firstly, the human detection in the image using a pretrained “You Only Look Once (YOLO)” method, which extracts the related bounding boxes containing his/her hands; secondly, the gesture detection/classification stage, which processes the bounding box images; and thirdly, we introduced a module called “counterGesture”, which triggers the alert.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Hand Gesture Recognition Systems · Human Pose and Action Recognition · Hearing Impairment and Communication
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Center for Basic and Applied Research, Faculty of Informatics and Management, University of Hradec Kralove, Rokitanskeho 62, 500 03 Hradec Kralove, Czech Republic
Department of Economy, Faculty of Informatics and Management, University of Hradec Kralove, Rokitanskeho 62, 500 03 Hradec Kralove, Czech Republic
Malaysia Japan International Institute of Technology (MJIIT), Universiti Teknologi Malaysia Kuala Lumpur, Jalan Sultan Yahya Petra, Kuala Lumpur 54100, Malaysia
Media and Games Center of Excellence (MagicX), Universiti Teknologi Malaysia, Skudai 81310, Malaysia
School of Computing, Faculty of Engineering, Universiti Teknologi Malaysia (UTM), Skudai 81310, Malaysia
References (53)
Show source-provided references
1. Rape myth acceptance, efficacy, and heterosexual scripts in men’s magazines: Factors associated with intentions to sexually coerce or intervene10.1177/0886260516653752 ↗
2. Smith, S.G., Chen, J., Basile, K.C., Gilbert, L.K., Merrick, M.T., Patel, N., Walling, M., and Jain, A. (2017). The National Intimate Partner and Sexual Violence Survey (NISVS): 2010-2012 State Report, National Center for Injury Prevention and Control, Centers for Disease Control and Prevention.
3. Sexual Harassment among Young Tourists Visiting Mediterranean Resorts10.1007/s10508-012-9979-6 ↗
4. The evolution of video surveillance: An overview10.1007/s00138-008-0152-0 ↗
5. Automated Real-Time Detection of Potentially Suspicious Behavior in Public Transport Areas10.1109/TITS.2012.2228640 ↗
6. Order-Preserving Condensation of Moving Objects in Surveillance Videos10.1109/TITS.2016.2518622 ↗
7. Hanson, G.C., Perrin, N., Moss, H., Laharnar, N., and Glass, N. (2015). Workplace violence against homecare workers and its relationship with workers health outcomes: A cross-sectional study. BMC Public Heal., 15.10.1186/s12889-014-1340-7 ↗
8. Poly-victimization and its relationship with emotional and social adjustment in adolescence: Evidence from a national survey in Switzerland10.1037/a0039993 ↗
9. Continuous hand gesture recognition based on trajectory shape information10.1016/j.patrec.2017.05.016 ↗
10. Deep convolution neural network for image recognition10.1016/j.ecoinf.2018.10.002 ↗
11. Deep Convolutional Neural Networks and Learning ECG Features for Screening Paroxysmal Atrial Fibrillation Patients10.1109/TSMC.2017.2705582 ↗
12. Convolutional neural networks on surfaces via seamless toric covers10.1145/3072959.3073616 ↗
13. Mambou, S.J., Maresova, P., Krejcar, O., Selamat, A., and Kuca, K. (2018). Breast Cancer Detection Using Infrared Thermal Imaging and a Deep Learning Model. Sensors, 18.10.3390/s18092799 ↗
14. Sieminski, A., Kozierkiewicz, A., Nunez, M., and Ha, Q.T. (2018). Breast Cancer Detection Using Modern Visual IT Techniques. Modern Approaches for Intelligent Information and Database Systems, Springer International Publishing.10.1007/978-3-319-76081-0 ↗
15. Rojas, I., Valenzuela, O., Rojas, F., and Ortuño, F. (2018). Novel Four Stages Classification of Breast Cancer Using Infrared Thermal Imaging and a Deep Learning Model. Bioinformatics and Biomedical Engineering, Springer International Publishing.
16. Nguyen, N.T., Gaol, F.L., Hong, T.P., and Trawiński, B. (2019). Approximate Outputs of Accelerated Turing Machines Closest to Their Halting Point. Intelligent Information and Database Systems, Springer International Publishing.
17. Mambou, S., Krejcar, O., Kuca, K., and Selamat, A. (2018). Novel Cross-View Human Action Model Recognition Based on the Powerful View-Invariant Features Technique. Future Internet, 10.10.3390/fi10090089 ↗
18. Sieminski, A., Kozierkiewicz, A., Nunez, M., and Ha, Q.T. (2018). Novel Human Action Recognition in RGB-D Videos Based on Powerful View Invariant Features Technique. Modern Approaches for Intelligent Information and Database Systems, Springer International Publishing. Studies in Computational Intelligence.
19. Integrating Orientation Cue With EOH-OLBP-Based Multilevel Features for Human Detection10.1109/TCSVT.2013.2268991 ↗
20. Upper Body Human Detection and Segmentation in Low Contrast Video10.1109/TCSVT.2013.2248285 ↗
21. Local Transform Features and Hybridization for Accurate Face and Human Detection10.1109/TPAMI.2012.219 ↗
22. Histograms of Oriented Gradients for Human Detection10.1109/CVPR.2005.177 ↗
23. (2019, May 26). Hedged Deep Tracking. Available online: https://www.computer.org/csdl/proceedings-article/cvpr/2016/07780835/12OmNrHjqOQ.
24. Wang, L., Ouyang, W., Wang, X., and Lu, H. (2015, January 7–13). Visual Tracking with Fully Convolutional Networks. Proceedings of the 2015 IEEE International Conference on Computer Vision (ICCV), Santiago, Chile.10.1109/ICCV.2015.357 ↗
25. Fu, Z., Angelini, F., Naqvi, S.M., and Chambers, J.A. (2018, January 15–20). GM-PHD Filter Based Online Multiple Human Tracking Using Deep Discriminative Correlation Matching. Proceedings of the 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Calgary, AB, Canada.10.1109/ICASSP.2018.8461946 ↗
26. Depth-Projection-Map-Based Bag of Contour Fragments for Robust Hand Gesture Recognition10.1109/THMS.2016.2616278 ↗
27. Mo, Z., and Neumann, U. (2006, January 17–22). Real-time hand pose recognition using low-resolution depth images. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, New York, NY, USA.
28. Ren, Z., Yuan, J., and Zhang, Z. (December, January 28). Robust Hand Gesture Recognition Based on Finger-earth Mover’s Distance with a Commodity Depth Camera. Proceedings of the 19th ACM International Conference on Multimedia, New York, NY, USA.
29. Gesture segmentation based on a two-phase estimation of distribution algorithm10.1016/j.ins.2017.02.021 ↗
30. Vision-based Hand Pose Estimation: A Review10.1016/j.cviu.2006.10.012 ↗
31. Oikonomidis, I., Kyriazis, N., and Argyros, A. (2011). Efficient model-based 3D tracking of hand articulations using Kinect. British Machine Vision Conference 2011, British Machine Vision Association.10.5244/C.25.101 ↗
32. Tang, M. (2011). Recognizing Hand Gestures with Microsoft’s Kinect, Stanford University.
33. 3D Shape Matching via Two Layer Coding10.1109/TPAMI.2015.2424863 ↗
34. Path Similarity Skeleton Graph Matching10.1109/TPAMI.2007.70769 ↗
35. Heterogeneous hand gesture recognition using 3D dynamic skeletal data10.1016/j.cviu.2019.01.008 ↗
36. Yang, J., Li, S., Gao, Z., Wang, Z., and Liu, W. (2018). Real-Time Recognition Method for 0.8 cm Darning Needles and KR22 Bearings Based on Convolution Neural Networks and Data Increase. Appl. Sci., 8.10.3390/app8101857 ↗
37. Redmon, J., Divvala, S., Girshick, R., and Farhadi, A. (2016, January 8). You Only Look Once: Unified, Real-Time Object Detection. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.10.1109/CVPR.2016.91 ↗
38. Simultaneous detection and classification of breast masses in digital mammograms via a deep learning YOLO-based CAD system10.1016/j.cmpb.2018.01.017 ↗
39. Tang, C., Ling, Y., Yang, X., Jin, W., and Zheng, C. (2018). Multi-View Object Detection Based on Deep Learning. Appl. Sci., 8.10.3390/app8091423 ↗
40. Yang, G., Yang, J., Sheng, W., Junior, F.E.F., and Li, S. (2018). Convolutional Neural Network-Based Embarrassing Situation Detection under Camera for Social Robot in Smart Homes. Sensors, 18.10.3390/s18051530 ↗
41. Multi-Agent Deep Reinforcement Learning for Multi-Object Tracker10.1109/ACCESS.2019.2901300 ↗
42. Bewley, A., Ge, Z., Ott, L., Ramos, F., and Upcroft, B. (2016, January 25–28). Simple online and realtime tracking. Proceedings of the 2016 IEEE International Conference on Image Processing (ICIP), Phoenix, AZ, USA.10.1109/ICIP.2016.7533003 ↗
43. Tran, D., Bourdev, L., Fergus, R., Torresani, L., and Paluri, M. (2014, January 7–13). Learning Spatiotemporal Features with 3D Convolutional Networks. Proceedings of the IEEE international Conference on Computer Vision, Washington, DC, USA.10.1109/ICCV.2015.510 ↗
44. A Web Service System Supporting Three-dimensional Post-processing of Medical Images Based on WADO Protocol10.1007/s10916-015-0196-4 ↗
45. (2019, May 26). The 20BN-JESTER Dataset—Twenty Billion Neurons. Available online: https://20bn.com/datasets/jester/v1#download.
46. (2019, May 26). Mumbai Girl Molesting CCTV footage—YouTube. Available online: https://www.youtube.com/watch?v=D8z1DAIo_Lg.
47. EgoGesture: A New Dataset and Benchmark for Egocentric Hand Gesture Recognition10.1109/TMM.2018.2808769 ↗
48. Fully automated organ segmentation in male pelvic CT images10.1088/1361-6560/aaf11c ↗
49. A survey of recent work on fine-grained image classification techniques10.1016/j.jvcir.2018.12.049 ↗
50. Cross-Resolution Feature Fusion for Fast Hand Detection in Intelligent Homecare Systems10.1109/JSEN.2019.2901259 ↗
51. Zhaodi, W., Menghan, H., and Guangtao, Z. (2018). Application of Deep Learning Architectures for Accurate and Rapid Detection of Internal Mechanical Damage of Blueberry Using Hyperspectral Transmittance Data. Sensors, 18.10.3390/s18041126 ↗
52. A Multi–Strategy Region Proposal Network10.1016/j.eswa.2018.06.043 ↗
53. Learning Rotation-Invariant and Fisher Discriminative Convolutional Neural Networks for Object Detection10.1109/TIP.2018.2867198 ↗