Explainable AI for DeepFake Detection
Source abstract
Abstract
The surge in technological advancements has resulted in concerns over its misuse in politics and entertainment, making reliable detection methods essential. This study introduces a deepfake detection technique that enhances interpretability using the network dissection algorithm. This research consists of two stages: (1) detection of forged images using advanced convolutional neural networks such as ResNet-50, Inception V3, and VGG-16, and (2) applying the network dissection algorithm to understand the models’ internal decision-making processes. The CNNs’ performance is evaluated through F1-scores ranging from 0.8 to 0.9, demonstrating their effectiveness. By analyzing the facial features learned by the models, this study provides explainable results for classifying images as real or fake. This interpretability is crucial in understanding how deepfake detection models operate. Although numerous detection models exist, they often lack transparency in their decision-making processes. This research fills that gap by offering insights into how these models distinguish real from manipulated images. The findings highlight the importance of interpretability in deep neural networks, providing a better understanding of their hierarchical structures and decision processes.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Adversarial Robustness in Machine Learning · Generative Adversarial Networks and Image Synthesis · Digital Media Forensic Detection
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Berlin School of Technology, SRH Berlin University of Applied Sciences, D-10587 Berlin, Germany
Institute of Mathematics and Informatics, Bulgarian Academy of Sciences, 1113 Sofia, Bulgaria
References (24)
Show source-provided references
1. Affirming wellness culture through innovative methodology related to Blaze-pod trainer system
2. Specificity of the motor potential for achieving Scholar Wellness
3. Ignatova, D. (2015, January 24–26). The effects of swimming on preschool children with spinal abnormalities. Proceedings of the 17th International Balkan Society for Pedagogy and Education/BASOPED/Conference, Varna, Bulgaria.
4. Motor activity based on learning—Contemporary trends in School Wellness
5. Rong, I. (2020). Detection and Segmentation of Deepfake Face Images Generated by GANs Using Segmented Based CNN. [Master′s Thesis, Dublin Business School].
6. Arai, K. (2023). Artificial Intelligence in Forensic Science. Advances in Information and Communication. FICC 2023. Lecture Notes in Networks and Systems, Springer.
7. Arai, K. (2023). Artificial Intelligence in Forensic Science. Intelligent Computing. SAI 2024. Lecture Notes in Networks and Systems, Springer.10.1007/978-3-031-62273-1 ↗
8. Nagahisarchoghaei, M., Nur, N., Cummins, L., Nur, N., Karimi, M.M., Nandanwar, S., Bhattacharyya, S., and Rahimi, S. (2023). An Empirical Survey on Explainable AI Technologies: Recent Trends, Use-Cases, and Categories from Technical and Application Perspectives. Electronics, 12.10.3390/electronics12051092 ↗
9. Bau, D., Zhou, B., Khosla, A., Oliva, A., and Torralba, A. (2017, January 21). Network Dissection: Quantifying Interpretability of Deep Visual Repre-sentations. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HA, USA.10.1109/CVPR.2017.354 ↗
10. Interpreting Deep Visual Representations via Network Dissection10.1109/TPAMI.2018.2858759 ↗
11. Interpreting Face Inference Models Using Hierarchical Network Dissection10.1007/s11263-022-01603-x ↗
12. Aceves-Fernandez, M.A. (2020). Explainable Artificial Intelligence (xAI) Approaches and Deep Meta-Learning Models. Advances and Applications in Deep Learning, InTechOpen.10.5772/intechopen.87786 ↗
13. Linardatos, P., Papastefanopoulos, V., and Kotsiantis, S. (2021). Explainable AI: A Review of Machine Learning Interpretability Methods. Entropy, 23.10.3390/e23010018 ↗
14. Molnar, C. (2023). Interpretable Machine Learning, Leanpub. [2nd ed.].
15. Holzinger, A., Goebel, R., Fong, R., Moon, T., Müller, K.R., and Samek, W. (2020). Explainable AI Methods—A Brief Overview. xxAI—Beyond Explainable AI. Lecture Notes in Computer Science, Springer.
16. Improving deep learning performance by using Explainable Artificial Intelligence (XAI) approaches10.1007/s44163-021-00008-y ↗
17. Pino, S., Carman, M., and Bestagini, P. (2021). What’s wrong with this video? Comparing Explainers for Deepfake Detection. arXiv.
18. Baldassarre, F., Debard, Q., Pontiveros, G.F., and Wijaya, T.K. (2022, January 21–24). Quantitative Metrics for Evaluating Explanations of Video DeepFake Detectors. Proceedings of the British Machine Vision Conference, London, UK.
19. Avidan, S., Brostow, G., Cissé, M., Farinella, G.M., and Hassner, T. (2022). Explaining Deepfake Detection by Analysing Image Matching. xComputer Vision—ECCV 2022. Lecture Notes in Computer Science, Springer.10.1007/978-3-031-19836-6 ↗
20. Narteni, S., Orani, V., Ferrari, E., Verda, D., Cambiaso, E., and Mongelli, M. (2022, January 17). A New XAI-based Evaluation of Generative Adversarial Networks for IMU Data Augmentation. Proceedings of the IEEE International Conference on E-Health Networking, Application Services, Genoa, Italy.10.36227/techrxiv.24166791.v1 ↗
21. Trinh, L., Tsang, M., Rambhatla, S., and Liu, Y. (2021, January 3). Interpretable and Trustworthy Deepfake Detection via Dynamic Prototypes. Proceedings of the IEEE Winter Conference on Applications of Computer Vision (WACV), Waikoloa, HI, USA.10.1109/WACV48630.2021.00202 ↗
22. Detecting Deepfake Images Using Deep Learning Techniques and Explainable AI Methods10.32604/iasc.2023.029653 ↗
23. Li, Y., Yang, X., Sun, P., Qi, H., and Lyu, S. (2020, January 14–19). Celeb-DF: A Large-scale Challenging Dataset for DeepFake Forensics. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Online.10.1109/CVPR42600.2020.00327 ↗
24. Liu, Z., Luo, P., Wang, X., and Tang, X. (2015, January 13–16). Deep Learning Face Attributes in the Wild. Proceedings of the International Conference on Computer Vision (ICCV), Santiago, Chile.10.1109/ICCV.2015.425 ↗