journal article·2022Open access

Multiple Forgery Detection in Video Using Convolution Neural Network

Vinay Kumar, Vineet Kansal, Manish Gaur

Computers, Materials & Continua· Volume 73· Issue 1

Abstract

With the growth of digital media data manipulation in today’s era due to the availability of readily handy tampering software, the authenticity of records is at high risk, especially in video. There is a dire need to detect such problem and do the necessary actions. In this work, we propose an approach to detect the interframe video forgery utilizing the deep features obtained from the parallel deep neural network model and thorough analytical computations. The proposed approach only uses the deep features extracted from the CNN model and then applies the conventional mathematical approach to these features to find the forgery in the video. This work calculates the correlation coefficient from the deep features of the adjacent frames rather than calculating directly from the frames. We divide the procedure of forgery detection into two phases–video forgery detection and video forgery classification. In video forgery detection, this approach detect input video is original or tampered. If the video is not original, then the video is checked in the next phase, which is video forgery classification. In the video forgery classification, method review the forged video for insertion forgery, deletion forgery, and also again check for originality. The proposed work is generalized and it is tested on two different datasets. The experimental results of our proposed model show that our approach can detect the forgery with the accuracy of 91% on VIFFD dataset, 90% in TDTV dataset and classify the type of forgery–insertion and deletion with the accuracy of 82% on VIFFD dataset, 86% on TDTV dataset. This work can helps in the analysis of original and tempered video in various domain.
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Digital Media Forensic Detection · Advanced Steganography and Watermarking Techniques · Law in Society and Culture

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (36)

Show source-provided references
1. The association between adolescent well-being and digital technology use10.1038/s41562-018-0506-1 ↗
2. Video content authentication techniques: A comprehensive survey10.1007/s00530-017-0538-9 ↗
3. Efficient data integrity auditing with corrupted data recovery for edge computing in enterprise multimedia security10.1007/s11042-019-08558-1 ↗
4. Exposing video inter-frame forgery by zernike opponent chromaticity moments and coarseness analysis10.1007/s00530-015-0478-1 ↗
5. Digital video tampering detection: An overview of passive techniques10.1016/j.diin.2016.06.003 ↗
6. A Comprehensive Analysis on Video Forgery Detection Techniques
7. Mesonet: A compact facial video forgery detection network
8. A novel video inter-frame forgery model detection scheme based on optical flow consistency
9. I. Goodfellow, Y. Bengio, A. Courville and Y. Bengio, “Deep learning,” volume 1 MIT Press Cambridge, Cambridge, 2016.
10. A system dynamics-based environmental benefit assessment model of construction waste reduction management at the design and construction stages10.1016/j.jclepro.2017.12.101 ↗
11. Motion-adaptive frame deletion detection for digital video forensics10.1109/TCSVT.2016.2593612 ↗
12. Detection and localization of copy-paste forgeries in digital videos10.1016/j.forsciint.2017.10.028 ↗
13. Video forgery detection using correlation of noise residue
14. Image forgery localization via fine-grained analysis of CFA artifacts10.1109/TIFS.2012.2202227 ↗
15. Detection and localization of inter-frame video forgeries based on inconsistency in correlation distribution between haralick coded frames10.1007/s11042-018-6570-8 ↗
16. Surrey university library for forensic analysis (SULFA) of video content
17. Traffic and statistical multiplexing characterization of 3-D video representation formats10.1109/TBC.2013.2244792 ↗
18. Use-IP Ltd, “Hikvision 4 K DS-2CD4A85F-I sample footage (Day and night),” 2021, [Online]. Available: https://www.youtube.com/watch?v=66Ob1aJedHc&t=14s, 2016.
19. Deep convolutional neural network for graphics forgery detection in video10.1007/s11277-020-07126-3 ↗
20. Local tampering detection in video sequences10.1109/MMSP.2013.6659337 ↗
21. Efficient dense-field copy–move forgery detection10.1109/TIFS.2015.2455334 ↗
22. Inter-frame forgery detection in h. 264 videos using motion and brightness gradients10.1007/s11042-017-4762-2 ↗
23. Video frame and region duplication forgery detection based on correlation coefficient and coefficient of variation10.1007/s11042-018-6585-1 ↗
24. Compressed residual-VGG16 CNN model for big data places image recognition
25. G. Bradski Reading and Writing Images and Video, 2021, [Online]. Available: https://docs.opencv.org/2.4/modules/highgui/doc/reading_and_writing_images_and_video.html# videocapture, 2021.
26. A theory based on conversion of rgb image to gray image10.5120/777-1099 ↗
27. Benesty · Noise Reduction in Speech Processing · 2009 · 1
28. The rationale of the mean-standard deviation analysis, skewness preference, and the demand for money
29. X. H. Nguyen, “VIFFD-A dataset for detecting video inter-frame forgeries,” 2020.
30. Detecting video inter-frame forgeries based on convolutional neural network model10.5815/ijigsp.2020.03.01 ↗
31. Video tampering dataset development in temporal domain for video forgery authentication10.1007/s11042-020-09205-w ↗
32. D. M. W. Powers, “Evaluation: From precision, recall and F-measure to ROC, informedness, markedness and correlation,” arXiv preprint arXiv: 2010.16061, 2020.
33. Labeled dataset for integral evaluation of moving object detection algorithms: Lasiesta10.1016/j.cviu.2016.08.005 ↗
34. Surveillance video authentication using universal image quality index of temporal average
35. Privacy protection in video surveillance systems: Analysis of subband-adaptive scrambling in jpeg xr10.1109/TCSVT.2011.2106250 ↗
36. Detection and localization of inter-frame forgeries in videos based on macroblock variation and motion vector analysis10.1016/j.compeleceng.2020.106929 ↗