Cover the Violence: A Novel Deep-Learning-Based Approach Towards Violence-Detection in Movies
Source abstract
Abstract
Movies have become one of the major sources of entertainment in the current era, which are based on diverse ideas. Action movies have received the most attention in last few years, which contain violent scenes, because it is one of the undesirable features for some individuals that is used to create charm and fantasy. However, these violent scenes have had a negative impact on kids, and they are not comfortable even for mature age people. The best way to stop under aged people from watching violent scenes in movies is to eliminate these scenes. In this paper, we proposed a violence detection scheme for movies that is comprised of three steps. First, the entire movie is segmented into shots, and then a representative frame from each shot is selected based on the level of saliency. Next, these selected frames are passed from a light-weight deep learning model, which is fine-tuned using a transfer learning approach to classify violence and non-violence shots in a movie. Finally, all the non-violence scenes are merged in a sequence to generate a violence-free movie that can be watched by children and as well violence paranoid people. The proposed model is evaluated on three violence benchmark datasets, and it is experimentally proved that the proposed scheme provides a fast and accurate detection of violent scenes in movies compared to the state-of-the-art methods.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Video Surveillance and Tracking Methods · Anomaly Detection Techniques and Applications · Human Pose and Action Recognition
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Intelligent Media Laboratory, Digital Contents Research Institute, Sejong University, Seoul 143-747, Korea
Department of Software, Sejong University, Seoul 143-747, Korea
References (36)
Show source-provided references
1. Elliott, C., and Dastidar, S.G. (2019). The Indian Film Industry in a Changing International Market. J. Cult. Econ., in press.10.1007/s10824-019-09351-6 ↗
2. Parental desensitization to gun violence in PG-13 movies10.1542/peds.2017-3491 ↗
3. PG-13 rated movie violence and societal violence: Is there a link?10.1007/s11126-018-9615-2 ↗
4. Evaluation of multiple features for violent scenes detection10.1007/s11042-016-3331-4 ↗
5. Can high-level concepts fill the semantic gap in video retrieval? A case study with broadcast news10.1109/TMM.2007.900150 ↗
6. Shafaei, M., Samghabadi, N.S., Kar, S., and Solorio, T. (2019). Rating for Parents: Predicting Children Suitability Rating for Movies Based on Language of the Movies. arXiv.
7. Nayak, L. (2015). Audio-Visual Content-Based Violent Scene Characterisation. [Ph.D. Thesis, National Institute of Technology].
8. Chen, L.-H., Hsu, H.-W., Wang, L.-Y., and Su, C.-W. (2011, January 17–19). Violence detection in movies. Proceedings of the 2011 Eighth International Conference Computer Graphics, Imaging and Visualization, Singapore.10.1109/CGIV.2011.14 ↗
9. DOVE: Detection of movie violence using motion intensity analysis on skin and blood
10. Zhang, B., Yi, Y., Wang, H., and Yu, J. (2014, January 16–17). MIC-TJU at MediaEval Violent Scenes Detection (VSD) 2014. Proceedings of the MediaEval 2014 Workshop, Barcelona, Spain.
11. Bilinski, P., and Bremond, F. (2016, January 23–26). Human violence recognition and detection in surveillance videos. Proceedings of the 2016 13th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS), Colorado Springs, CO, USA.10.1109/AVSS.2016.7738019 ↗
12. Automatic fight detection in surveillance videos10.1108/IJPCC-02-2017-0018 ↗
13. Lin, J., and Wang, W. (2009). Weakly-supervised violence detection in movies with audio and video based co-training. Pacific-Rim Conference on Multimedia, Springer.10.1007/978-3-642-10467-1_84 ↗
14. Hassner, T., Itcher, Y., and Kliper-Gross, O. (2012, January 16–21). Violent flows: Real-time detection of violent crowd behavior. Proceedings of the 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, Providence, RI, USA.10.1109/CVPRW.2012.6239348 ↗
15. Spatio-temporal feature using optical flow based distribution for violence detection10.1016/j.patrec.2017.04.015 ↗
16. Khan, M., Tahir, M.A., and Ahmed, Z. (2018, January 1–2). Detection of violent content in cartoon videos using multimedia content detection techniques. Proceedings of the 2018 IEEE 21st International Multi-Topic Conference (INMIC), Karachi, Pakistan.10.1109/INMIC.2018.8595563 ↗
17. Nguyen, N.T., Phung, D.Q., Venkatesh, S., and Bui, H. (2005, January 20–25). Learning and detecting activities from movement trajectories using the hierarchical hidden Markov model. Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR’05), San Diego, CA, USA.
18. Mahadevan, V., Li, W., Bhalodia, V., and Vasconcelos, N. (2010, January 13–18). Anomaly detection in crowded scenes. Proceedings of the 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, San Francisco, CA, USA.10.1109/CVPR.2010.5539872 ↗
19. Huang, J.-F., and Chen, S.-L. (2014, January 19–21). Detection of violent crowd behavior based on statistical characteristics of the optical flow. Proceedings of the 2014 11th International Conference on Fuzzy Systems and Knowledge Discovery (FSKD), Xiamen, China.10.1109/FSKD.2014.6980896 ↗
20. A new method for violence detection in surveillance scenes10.1007/s11042-015-2648-8 ↗
21. Nievas, E.B., Suarez, O.D., García, G.B., and Sukthankar, R. (2011). Violence detection in video using computer vision techniques. International conference on Computer Analysis of Images and Patterns, Springer.10.1007/978-3-642-23678-5_39 ↗
22. Gracia, I.S., Suarez, O.D., Garcia, G.B., and Kim, T.-K. (2015). Fast fight detection. PLoS ONE, 10.10.1371/journal.pone.0120448 ↗
23. A Novel Violent Video Detection Scheme Based on Modified 3D Convolutional Neural Networks10.1109/ACCESS.2019.2906275 ↗
24. Ullah, F.U.M., Ullah, A., Muhammad, K., Haq, I.U., and Baik, S.W. (2019). Violence detection using spatiotemporal features with 3D convolutional neural network. Sensors, 19.10.3390/s19112472 ↗
25. Mu, G., Cao, H., and Jin, Q. (2016). Violent scene detection using convolutional neural networks and deep audio features. Chinese Conference on Pattern Recognition, Springer.10.1007/978-981-10-3005-5_37 ↗
26. Benini, S., Savardi, M., Bálint, K., Kovács, A.B., and Signoroni, A. (2019). On the influence of shot scale on film mood and narrative engagement in film viewers. IEEE Trans. Affect. Comput.
27. Violent scene detection algorithm based on kernel extreme learning machine and three-dimensional histograms of gradient orientation10.1007/s11042-018-6923-3 ↗
28. Li, Z., Liu, X., and Zhang, S. (2016, January 1–3). Shot boundary detection based on multilevel difference of colour histograms. Proceedings of the 2016 First International Conference on Multimedia and Image Processing (ICMIP), Bandar Seri Begawan, Brunei.10.1109/ICMIP.2016.24 ↗
29. Tavakoli, H.R., Rahtu, E., and Heikkilä, J. (2011). Fast and efficient saliency detection using sparse sampling and kernel density estimation. Scandinavian Conference on Image Analysis, Springer.
30. Zhang, X., Yao, L., Wang, X., Monaghan, J., and Mcalpine, D. (2019). A Survey on Deep Learning based Brain Computer Interface: Recent Advances and New Frontiers. arXiv.
31. Exploiting convolutional neural networks with deeply local description for remote sensing image classification10.1109/ACCESS.2018.2798799 ↗
32. Personalized Movie Summarization Using Deep CNN-Assisted Facial Expression Recognition
33. VSD, a public dataset for the detection of violent scenes in movies: Design, annotation, analysis and evaluation10.1007/s11042-014-1984-4 ↗
34. Hussain, T., Muhammad, K., Ullah, A., Cao, Z., Baik, S.W., and de Albuquerque, V.H.C. (2019). Cloud-assisted multi-view video summarization using CNN and bi-directional LSTM. IEEE Trans. Ind. Inform., in press.10.1109/TII.2019.2929228 ↗
35. Muhammad, K., Hussain, T., and Baik, S.W. (2018). Efficient CNN based summarization of surveillance videos for resource-constrained devices. Pattern Recognit. Lett., in press.
36. Intelligent Baby Behavior Monitoring using Embedded Vision in IoT for Smart Healthcare Centers. Journal of Artificial Intelligence and Systems