journal article·2025-11-29Open access

Forensic Analysis of Manipulated Images and Videos

Sergio A. Falcón-López, Llanos Tobarra, Antonio Robles-Gómez, Rafael Pastor-Vargas

Applied Sciences· Volume 15· Issue 23

Abstract

The transition from Industry 4.0 to Industry 5.0 emphasizes the need for ethical, transparent, and human-centric artificial intelligence systems. In this context, ensuring the authenticity of digital information has become crucial for maintaining societal trust. This study addresses the challenge of detecting manipulated multimedia content, including synthetic images, videos, and audio generated by artificial intelligence, commonly known as Deepfakes. We analyze and compare general-purpose and Deepfake-specific detection methods to assess their effectiveness in real-world scenarios. This work introduces a refined reference model that integrates both application-oriented and methodological criteria, grouping tools into Blind Forensic, Handcrafted Machine Learning, Deep Learning-based methods, and Toolkits. This structured taxonomy provides a clearer comparative framework than existing works, which typically classify detectors using only one of these dimensions. To ensure reproducible evaluation, all experiments were performed using the SAFL dataset, which consolidates real and synthetic multimedia content generated with publicly available tools under a unified protocol. Among the tested tools, Forensically achieved the highest accuracy in image forgery detection 86.9%, while Autopsy reached 69.5% among Deepfake-specific image detectors. In video analysis, Forensically obtained 98.6% accuracy, whereas Deepware Scanner achieved 91.2% as the most effective Deepfake-focused tool. These results highlight that general-purpose methods remain robust for images, while specialized detectors perform competitively in videos. Overall, the proposed model and dataset establish a consistent foundation for advancing hybrid detection strategies aligned with the ethical and transparent AI principles envisioned in Industry 5.0.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Digital Media Forensic Detection · Digital and Cyber Forensics · Generative Adversarial Networks and Image Synthesis

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Programa de Doctorado en Tecnologías Industriales, Escuela Internacional de Doctorado UNED (EIDUNED), Universidad Nacional de Educacion a Distancia (UNED), 28040 Madrid, Spain

Control and Communication System Department, Computer Science Engineering Faculty, Universidad Nacional de Educacion a Distancia (UNED), 28040 Madrid, Spain

References (59)

Show source-provided references
1. INCIBE (2025, November 22). Deepfakes. (In Spanish).
2. Fake News on the Internet: A Literature Review, Synthesis and Directions for Future Research10.1108/INTR-05-2021-0294 ↗
3. Deepfake Detection: A Comprehensive Survey from the Reliability Perspective
4. Foreign object detection in urban rail transit based on deep differentiation segmentation neural network10.1016/j.heliyon.2024.e37072 ↗
5. Elías, C., Montoro, P., Osuna, S., Fernádez-Roldán, A., Robles-Gómez, A., and Gálvez, T. (2025, November 22). Fake News. La fábrica de Mentiras. TVE2 and UNED Canal. (In Spanish).
6. Media Forensics and DeepFakes: An Overview10.1109/JSTSP.2020.3002101 ↗
7. FaceApp (2025, November 22). FaceApp. Available online: https://www.faceapp.com/.
8. Perov, I., Gao, D., Chervoniy, N., Liu, K., Marangonda, S., Umé, C., Dpfks, M., Facenheim, C.S., RP, L., and Jiang, J. (2021). DeepFaceLab: Integrated, flexible and extensible face-swapping framework. arXiv.
9. A Survey on Digital Image Forensic Methods Based on Blind Forgery Detection10.1007/s11042-023-18090-y ↗
10. Wagner, J. (2025, November 22). Forensically. Available online: https://29a.ch/photo-forensics.
11. Tanasi, A., and Buoncristiano, M. (2025, November 22). Ghiro: Automated Digital Image Forensics Tool. Available online: https://github.com/Ghirensics/ghiro.
12. Emergence of Deepfakes and Video Tampering Detection Approaches: A Survey10.1007/s11042-022-13100-x ↗
13. Ferreira, S., Antunes, M.J.G., and Correia, M.E. (2021). Exposing Manipulated Photos and Videos in Digital Forensics Analysis. J. Imaging, 7.10.3390/jimaging7070102 ↗
14. Analysis and Experimentation on the ManTraNet Image Forgery Detector10.5201/ipol.2022.431 ↗
15. kPsarakis (2025, November 22). Image Forgery Detection with CNN. Available online: https://github.com/kPsarakis/Image-Forgery-Detection-CNN.
16. Enhancing DeepFake Detection: Leveraging MesoNet for Video Fraud Identification10.1007/s42979-024-02629-3 ↗
17. Deepware (2025, November 22). Deepware Scanner. Available online: https://deepware.ai/.
18. Block-Level Double JPEG Compression Detection for Image Forgery Localization10.1007/s11042-023-15942-5 ↗
19. Li, Y., Gardella, M., Bammey, Q., Nikoukhah, T., Morel, J.M., Colom, M., and Von Gioi, R.G. (2023, January 8–11). A Contrario Detection of H.264 Video Double Compression. Proceedings of the International Conference on Image Processing (ICIP), Kuala Lumpur, Malaysia.10.1109/ICIP49359.2023.10222775 ↗
20. An End-to-End Dense-InceptionNet for Image Copy-Move Forgery Detection10.1109/TIFS.2019.2957693 ↗
21. MSRD-CNN: Multi-Scale Residual Deep CNN for General-Purpose Image Manipulation Detection10.1109/ACCESS.2022.3167714 ↗
22. (2025, November 22). INCIBE. (In Spanish).
23. Hass, C. (2025, November 22). JPEGsnoop: JPEG Image Decoder and Analysis Tool. Available online: https://github.com/ImpulseAdventure/JPEGsnoop.
24. Harvey, P. (2025, November 22). ExifTool by Phil Harvey. Available online: https://exiftool.org.
25. (2025, November 22). Autopsy. Available online: https://www.autopsy.com/.
26. Liu, H., Toubal, I., and Bonilla, H. (2025, November 22). Deepfake-Detection. Available online: https://github.com/HongguLiu/Deepfake-Detection.
27. Rössler, A., Cozzolino, D., Verdoliva, L., Riess, C., Thies, J., and Nießner, M. (November, January 27). FaceForensics++: Learning to Detect Manipulated Facial Images. Proceedings of the International Conference on Computer Vision (ICCV), Seoul, Republic of Korea.
28. OPENAI (2025, November 22). Dall-E 3. Available online: https://openai.com/dall-e-3/.
29. TPDNE (2025, November 22). This Person Does Not Exist. Available online: https://this-person-does-not-exist.com/.
30. Karras, T., Laine, S., Aittala, M., Hellsten, J., Lehtinen, J., and Aila, T. (2020, January 13–19). Analyzing and Improving the Image Quality of StyleGAN. Proceedings of the 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA.10.1109/CVPR42600.2020.00813 ↗
31. ALIEVK (2025, November 22). Avatarify. Available online: https://github.com/alievk/avatarify-desktop,.
32. Altuncu, E., Franqueira, V.N.L., and Li, S. (2024). Deepfake: Definitions, Performance Metrics and Standards, Datasets, and a Meta-Review. Front. Big Data, 7.10.3389/fdata.2024.1400024 ↗
33. Korshunov, P., and Marcel, S. (2019, January 4–7). Vulnerability Assessment and Detection of Deepfake Videos. Proceedings of the 2019 International Conference on Biometrics (ICB), Crete, Greece.10.1109/ICB45273.2019.8987375 ↗
34. Li, Y., Chang, M.C., and Lyu, S. (2018, January 11–13). In Ictu Oculi: Exposing AI Created Fake Videos by Detecting Eye Blinking. Proceedings of the 2018 IEEE International Workshop on Information Forensics and Security (WIFS), Hong Kong, China.10.1109/WIFS.2018.8630787 ↗
35. Rössler, A., Cozzolino, D., Verdoliva, L., Riess, C., Thies, J., and Nießner, M. (2018). FaceForensics: A Large-Scale Video Dataset for Forgery Detection in Human Faces. arXiv.
36. Li, Y., Yang, X., Sun, P., Qi, H., and Lyu, S. (2020, January 13–19). Celeb-DF: A Large-Scale Challenging Dataset for DeepFake Forensics. Proceedings of the 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA.10.1109/CVPR42600.2020.00327 ↗
37. Dolhansky, B., Bitton, J., Pflaum, B., Lu, J., Howes, R., Wang, M., and Canton Ferrer, C. (2020). The DeepFake Detection Challenge (DFDC) Dataset. arXiv.
38. Zi, B., Chang, M., Chen, J., Ma, X., and Jiang, Y.G. (2024). WildDeepfake: A Challenging Real-World Dataset for Deepfake Detection. arXiv.
39. Cai, Z., Ghosh, S., Adatia, A.P., Hayat, M., Dhall, A., Gedeon, T., and Stefanov, K. (November, January 28). AV-Deepfake1M: A Large-Scale LLM-Driven Audio-Visual Deepfake Dataset. Proceedings of the 32nd ACM International Conference on Multimedia, Melbourne, Australia. MM ’24.
40. Zhou, P., Han, X., Morariu, V.I., and Davis, L.S. (2017, January 21–26). Two-Stream Neural Networks for Tampered Face Detection. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Honolulu, HI, USA.10.1109/CVPRW.2017.229 ↗
41. Vedaldi, A., Bischof, H., Brox, T., and Frahm, J.M. (2020, January 23–28). CelebA-Spoof: Large-Scale Face Anti-Spoofing Dataset with Rich Annotations. Proceedings of the Computer Vision—ECCV 2020, Virtually.
42. Dang, H., Liu, F., Stehouwer, J., Liu, X., and Jain, A.K. (2020, January 13–19). On the Detection of Digital Face Manipulation. Proceedings of the 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA.10.1109/CVPR42600.2020.00582 ↗
43. Wang, Z., Bao, J., Zhou, W., Wang, W., Hu, H., Chen, H., and Li, H. (2023, January 1–6). DIRE for Diffusion-Generated Image Detection. Proceedings of the 2023 IEEE/CVF International Conference on Computer Vision (ICCV), Paris, France.10.1109/ICCV51070.2023.02051 ↗
44. Song, H., Huang, S., Dong, Y., and Tu, W.W. (2023). Robustness and Generalizability of Deepfake Detection: A Study with Diffusion Models. arXiv.
45. Falcón-López, S.A. (2025, November 22). Synthetic and Authentic Forensic Lab. Available online: https://github.com/oigres5/SAFL.
46. Deepfakes and beyond: A Survey of face manipulation and fake detection10.1016/j.inffus.2020.06.014 ↗
47. Akhtar, Z. (2023). Deepfakes Generation and Detection: A Short Survey. J. Imaging, 9.10.3390/jimaging9010018 ↗
48. Generative Adversarial Networks for Text-to-Face Synthesis & Generation: A Quantitative–Qualitative Analysis of Natural Language Processing Encoders for Spanish10.1016/j.ipm.2024.103667 ↗
49. Thies, J., Zollhöfer, M., Stamminger, M., Theobalt, C., and Nießner, M. (2020). Face2Face: Real-time Face Capture and Reenactment of RGB Videos. arXiv.
50. Studio, O. (2025, November 22). OBS Studio. Available online: https://obsproject.com/.
51. kPsarakis (2025, November 22). Image Forgery Detection with CNN—Report. Available online: https://github.com/kPsarakis/Image-Forgery-Detection-CNN/blob/master/reports/Group_10-Image_Forgery_Detection_report.pdf.
52. DariusAf (2025, November 22). MesoNet. Available online: https://github.com/DariusAf/MesoNet.
53. Ferreira, S., Antunes, M.J.G., and Correia, M.E. (2025, November 22). Photo and Video Manipulations Detector. Available online: https://github.com/saraferreirascf/Photo-and-video-manipulations-detector.
54. UNED (2025, November 22). Analysis of Mobile Applications from the Perspective of Data Protection. Available online: https://srise.informatica.uned.es/proyecto/.
55. UNED (2025, November 22). Smart Rural IoT and Secured Environments. Available online: https://srise.informatica.uned.es/.
56. (2025, November 22). NextGenerationEU. Available online: https://next-generation-eu.europa.eu/.
57. (2025, November 22). CiberCSI. Available online: https://blogs.uned.es/cibercsi/.
58. (2025, November 22). CiberGID. Available online: https://blogs.uned.es/cibergid/.
59. (2025, November 22). In4Labs. Available online: https://open.ieec.uned.es/in4labs/.