journal article·2022-09-29Open access

A Novel Deep Learning Approach for Deepfake Image Detection

Ali Raza, Kashif Munir, Mubarak Almutairi

Applied Sciences· Volume 12· Issue 19

Abstract

Deepfake is utilized in synthetic media to generate fake visual and audio content based on a person’s existing media. The deepfake replaces a person’s face and voice with fake media to make it realistic-looking. Fake media content generation is unethical and a threat to the community. Nowadays, deepfakes are highly misused in cybercrimes for identity theft, cyber extortion, fake news, financial fraud, celebrity fake obscenity videos for blackmailing, and many more. According to a recent Sensity report, over 96% of the deepfakes are of obscene content, with most victims being from the United Kingdom, United States, Canada, India, and South Korea. In 2019, cybercriminals generated fake audio content of a chief executive officer to call his organization and ask them to transfer $243,000 to their bank account. Deepfake crimes are rising daily. Deepfake media detection is a big challenge and has high demand in digital forensics. An advanced research approach must be built to protect the victims from blackmailing by detecting deepfake content. The primary aim of our research study is to detect deepfake media using an efficient framework. A novel deepfake predictor (DFP) approach based on a hybrid of VGG16 and convolutional neural network architecture is proposed in this study. The deepfake dataset based on real and fake faces is utilized for building neural network techniques. The Xception, NAS-Net, Mobile Net, and VGG16 are the transfer learning techniques employed in comparison. The proposed DFP approach achieved 95% precision and 94% accuracy for deepfake detection. Our novel proposed DFP approach outperformed transfer learning techniques and other state-of-the-art studies. Our novel research approach helps cybersecurity professionals overcome deepfake-related cybercrimes by accurately detecting the deepfake content and saving the deepfake victims from blackmailing.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Digital Media Forensic Detection · Generative Adversarial Networks and Image Synthesis · Advanced Steganography and Watermarking Techniques

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Institute of Computer Science, Khwaja Fareed University of Engineering and Information Technology, Rahim Yar Khan 64200, Pakistan

Institute of Information Technology, Khawaja Fareed University of Engineering & IT, Rahim Yar Khan 64200, Pakistan

College of Computer Science and Engineering, University of Hafr Al Batin, Hafr Alabtin 31991, Saudi Arabia

Funding

University of Hafr Albatin, Saudi Arabia

References (31)

Show source-provided references
1. Zobaed, S., Rabby, F., Hossain, I., Hossain, E., Hasan, S., Karim, A., and Hasib, K.M. (2021). Deepfakes: Detecting forged and synthetic media content using machine learning. Artificial Intelligence in Cyber Security: Impact and Implications, Springer.10.1007/978-3-030-88040-8_7 ↗
2. DeepFake electrocardiograms using generative adversarial networks are the beginning of the end for privacy issues in medicine10.1038/s41598-021-01295-2 ↗
3. Ahmed, M.F.B., Miah, M.S.U., Bhowmik, A., and Sulaiman, J.B. (2021, January 4–5). Awareness to Deepfake: A resistance mechanism to Deepfake. Proceedings of the 2021 International Congress of Advanced Technology and Engineering (ICOTEN), Taiz, Yemen.10.1109/ICOTEN52080.2021.9493549 ↗
4. Gautam, N., and Vishwakarma, D.K. (2022). Obscenity Detection in Videos through a Sequential ConvNet Pipeline Classifier. IEEE Trans. Cogn. Dev. Syst.10.1109/TCDS.2022.3158613 ↗
5. Naik, R. (2022, July 25). Deepfake Crimes: How Real and Dangerous They Are in 2021?. Available online: https://cooltechzone.com/research/deepfake-crimes.
6. Bracken, B. (2022, July 25). Deepfake Attacks Are About to Surge, Experts Warn|Threatpost. Available online: https://threatpost.com/deepfake-attacks-surge-experts-warn/165798/.
7. Lee, H., Park, S.H., Yoo, J.H., Jung, S.H., and Huh, J.H. (2020). Face recognition at a distance for a stand-alone access control system. Sensors, 20.10.3390/s20030785 ↗
8. AlBdairi, A.J.A., Xiao, Z., Alkhayyat, A., Humaidi, A.J., Fadhel, M.A., Taher, B.H., Alzubaidi, L., Santamaría, J., and Al-Shamma, O. (2022). Face Recognition Based on Deep Learning and FPGA for Ethnicity Identification. Appl. Sci., 12.10.3390/app12052605 ↗
9. A feature-level fusion based improved multimodal biometric recognition system using ear and profile face10.1007/s12652-021-02952-0 ↗
10. Ismail, A., Elpeltagy, M., S. Zaki, M., and Eldahshan, K. (2021). A New Deep Learning-Based Methodology for Video Deepfake Detection Using XGBoost. Sensors, 21.10.3390/s21165413 ↗
11. YOLO-face: A real-time face detector10.1007/s00371-020-01831-7 ↗
12. Pan, D., Sun, L., Wang, R., Zhang, X., and Sinnott, R.O. (2020, January 7–10). Deepfake Detection through Deep Learning. Proceedings of the 2020 IEEE/ACM International Conference on Big Data Computing, Applications and Technologies (BDCAT), Leicester, UK.10.1109/BDCAT50828.2020.00001 ↗
13. DeepVision: Deepfakes Detection Using Human Eye Blinking Pattern10.1109/ACCESS.2020.2988660 ↗
14. Lewis, J.K., Toubal, I.E., Chen, H., Sandesera, V., Lomnitz, M., Hampel-Arias, Z., Prasad, C., and Palaniappan, K. (2020, January 13–15). Deepfake Video Detection Based on Spatial, Spectral, and Temporal Inconsistencies Using Multimodal Deep Learning. Proceedings of the 2020 IEEE Applied Imagery Pattern Recognition Workshop (AIPR), Washington, DC, USA.10.1109/AIPR50011.2020.9425167 ↗
15. Hsu, C.C., Zhuang, Y.X., and Lee, C.Y. (2020). Deep fake image detection based on pairwise learning. Appl. Sci., 10.10.3390/app10010370 ↗
16. Machine learning based medical image deepfake detection: A comparative study
17. Rana, M.S., and Sung, A.H. (2020, January 1–3). DeepfakeStack: A Deep Ensemble-based Learning Technique for Deepfake Detection. Proceedings of the 2020 7th IEEE International Conference on Cyber Security and Cloud Computing (CSCloud)/2020 6th IEEE International Conference on Edge Computing and Scalable Cloud (EdgeCom), New York, NY, USA.10.1109/CSCloud-EdgeCom49738.2020.00021 ↗
18. CIPLAB @ YONSEI UNIVERSITY (2022, July 14). Real and Fake Face Detection|Kaggle. Available online: https://www.kaggle.com/datasets/ciplab/real-and-fake-face-detection.
19. Deep facial diagnosis: Deep transfer learning from face recognition to facial diagnosis10.1109/ACCESS.2020.3005687 ↗
20. ViXNet: Vision Transformer with Xception Network for deepfakes based video and image forgery detection10.1016/j.eswa.2022.118423 ↗
21. Radhika, K., Devika, K., Aswathi, T., Sreevidya, P., Sowmya, V., and Soman, K. (2020). Performance analysis of NASNet on unconstrained ear recognition. Nature Inspired Computing for Data Science, Springer.10.1007/978-3-030-33820-6_3 ↗
22. Yousfi, Y., Butora, J., Khvedchenya, E., and Fridrich, J. (2020, January 6–11). ImageNet pre-trained CNNs for JPEG steganalysis. Proceedings of the 2020 IEEE International Workshop on Information Forensics and Security (WIFS), New York, NY, USA.10.1109/WIFS49906.2020.9360897 ↗
23. Venkateswarlu, I.B., Kakarla, J., and Prakash, S. (2020, January 3–5). Face mask detection using mobilenet and global pooling block. Proceedings of the 2020 IEEE 4th conference on information & communication technology (CICT), Chennai, India,.10.1109/CICT51604.2020.9312083 ↗
24. CNN with depthwise separable convolutions and combined kernels for rating prediction10.1016/j.eswa.2020.114528 ↗
25. Jiang, Z.P., Liu, Y.Y., Shao, Z.E., and Huang, K.W. (2021). An Improved VGG16 Model for Pneumonia Image Classification. Appl. Sci., 11.10.3390/app112311185 ↗
26. Ansari, S., Alnajjar, K.A., Abdallah, S., Saad, M., and El-Moursy, A.A. (2021, January 14–15). Parameter Tuning of MLP, RBF, and ANFIS Models Using Genetic Algorithm in Modeling and Classification Applications. Proceedings of the 2021 International Conference on Information Technology (ICIT), Amman, Jordan.10.1109/ICIT52682.2021.9491682 ↗
27. Lee, S., Kim, J., Kang, H., Kang, D.Y., and Park, J. (2021). Genetic algorithm based deep learning neural network structure and hyperparameter optimization. Appl. Sci., 11.10.3390/app11020744 ↗
28. Indra, E., Yasir, M., Andrian, A., Sitanggang, D., Sihombing, O., Tamba, S.P., and Sagala, E. (2020, January 25–27). Design and Implementation of Student Attendance System Based on Face Recognition by Haar-Like Features Methods. Proceedings of the 2020 3rd International Conference on Mechanical, Electronics, Computer, and Industrial Technology (MECnIT), Medan, Indonesia.10.1109/MECnIT48290.2020.9166595 ↗
29. Hyperspectral image classification with convolutional neural network and active learning10.1109/TGRS.2020.2964627 ↗
30. A Lightweight Model of VGG-16 for Remote Sensing Image Classification10.1109/JSTARS.2021.3090085 ↗
31. Phiphiphatphaisit, S., and Surinta, O. (2020, January 19–22). Food image classification with improved MobileNet architecture and data augmentation. Proceedings of the 2020 The 3rd International Conference on Information Science and System, Cambridge, UK.10.1145/3388176.3388179 ↗