DeepFake Videos Detection Based on Texture Features
Source abstract
Abstract
In recent years, with the rapid development of deep learning technologies, some neural network models have been applied to generate fake media. DeepFakes, a deep learning based forgery technology, can tamper with the face easily and generate fake videos that are difficult to be distinguished by human eyes. The spread of face manipulation videos is very easy to bring fake information. Therefore, it is important to develop effective detection methods to verify the authenticity of the videos. Due to that it is still challenging for current forgery technologies to generate all facial details and the blending operations are used in the forgery process, the texture details of the fake face are insufficient. Therefore, in this paper, a new method is proposed to detect DeepFake videos. Firstly, the texture features are constructed, which are based on the gradient domain, standard deviation, gray level co-occurrence matrix and wavelet transform of the face region. Then, the features are processed by the feature selection method to form a discriminant feature vector, which is finally employed to SVM for classification at the frame level. The experimental results on the mainstream DeepFake datasets demonstrate that the proposed method can achieve ideal performance, proving the effectiveness of the proposed method for DeepFake videos detection.
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Digital Media Forensic Detection · Generative Adversarial Networks and Image Synthesis · Advanced Steganography and Watermarking Techniques
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (35)
Show source-provided references
1. Review on video object tracking based on deep learning10.32604/jnm.2019.06253 ↗
2. Multiple faces tracking using feature fusion and neural network in video10.32604/iasc.2020.011721 ↗
3. Fast Face-Swap using convolutional neural networks
4. On face segmentation, face swapping, and face perception
5. Blind forensics of successive geometric transformations in digital images using spectral method: Theory and applications10.1109/TIP.2017.2682963 ↗
6. An efficient detection approach of content aware image resizing10.32604/cmc.2020.09770 ↗
7. Multi-purpose forensics of image manipulations using residual-based feature10.32604/cmc.2020.011006 ↗
8. Celeb-DF: A large-scale challenging dataset for DeepFake forensics
9. Deepfake video detection using recurrent neural networks
10. In ictu oculi: Exposing AI created fake videos by detecting eye blinking
11. Y. Li and S. Lyu, “Exposing DeepFake videos by detecting face warping artifacts,” arXiv preprint arXiv: 1811.00656, 2018.
12. MesoNet: A compact facial video forgery detection network
13. Multi-task learning for detecting and segmenting manipulated facial images and videos
14. Exposing deep fakes using inconsistent head poses
15. Protecting world leaders against DeepFakes
16. DeepVision: Deepfakes detection using human eye blinking pattern10.1109/ACCESS.2020.2988660 ↗
17. Two-Stream neural networks for tampered face detection
18. Exploiting visual artifacts to expose Deepfakes and face manipulations
19. P. Korshunov and S. Marcel, “Deepfakes: A new threat to face recognition? Assessment and detection,” arXiv preprint arXiv: 1812.08685, 2018.
20. Global texture enhancement for fake face detection in the wild
21. M. Bonomi, C. Pasquini and G. Boato, “Dynamic texture analysis for detecting fake faces in video sequences,” arXiv preprint arXiv: 2007.15271, 2020.10.1016/j.jvcir.2021.103239 ↗
22. X. Sun, B. Wu and W. Chen, “Identifying invariant texture violation for robust Deepfake detection,” arXiv preprint arXiv: 2012.10580, 2020.
23. A method for detecting human-face-tampered videos based on interframe difference
24. Tuceryan · Handbook of Pattern Recognition & Computer Vision · 1993 · 23510.1142/9789814343138_0010 ↗
25. Textural features for image classification10.1109/TSMC.1973.4309314 ↗
26. A comparative study of texture measures with classification based on featured distributions10.1016/0031-3203(95)00067-4 ↗
27. Classification of textures using gaussian markov random fields10.1109/TASSP.1985.1164641 ↗
28. Texture segmentation using wavelet transform10.1016/j.patrec.2003.08.005 ↗
29. An investigation of the textural characteristics associated with gray level cooccurrence matrix statistical parameters10.1109/TGRS.1995.8746010 ↗
30. Image-based classification of paper surface quality using wavelet texture analysis10.1016/j.compchemeng.2010.06.013 ↗
31. Dlib-ml: A machine learning toolkit
32. Noise adaptive wiener filtering of images
33. Noise reduction of SEM images using adaptive Wiener filter
34. Faceforensics++: Learning to detect manipulated facial images
35. B. Dolhansky, R. Howes, B. Pflaum, N. Baram and C. C. Ferrer, “The deepfake detection challenge (DFDC) preview dataset” arXiv preprint arXiv: 1910.08854, 2019.