Dual-Module Architecture for Robust Image Forgery Segmentation and Classification Toward Cyber Fraud Investigation
Source abstract
Abstract
This study presents a dual-module architecture for image forgery detection in the context of cyber fraud investigation, designed to provide interpretable and court-admissible forensic evidence. The forgery segmentation module built on an encoder–decoder structure segments forged regions at the pixel level to produce a binary mask. The forgery classification module with two-stream structure integrates contextual and noise-residual cues from the raw image and the binary mask to determine the designated forgery method. The segmentation module achieves an F1-Score of 0.875 and an IoU of 0.78, while the classification module reaches an F1-Score of 0.94. The combined system attains an end-to-end F1-Score of 0.855 and AUC of 0.91, demonstrating reliable detection performance and enhanced explainability. These results highlight the framework’s potential for forensic image analysis and its practical applicability to real-world cyber fraud investigations.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Digital Media Forensic Detection · Generative Adversarial Networks and Image Synthesis · Imbalanced Data Classification Techniques
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Forensic Information Science and Technology, Legal Informatics and Forensic Science Institute, Hallym University, Chuncheonsi 24252, Republic of Korea
Funding
Hallym University Research Fund · Korean National Police Agency
References (28)
Show source-provided references
1. Gill, N.K., Garg, R., and Doegar, E.A. (2017, January 3–5). A review paper on digital image forgery detection techniques. Proceedings of the 2017 8th International Conference on Computing, Communication and Networking Technologies (ICCCNT), Delhi, India.10.1109/ICCCNT.2017.8203904 ↗
2. Kim, H. (2025). Novel Deep Learning-Based Facial Forgery Detection for Effective Biometric Recognition. Appl. Sci., 15.10.3390/app15073613 ↗
3. Image forgery detection techniques: Latest trends and key challenges10.1109/ACCESS.2024.3498340 ↗
4. Copy-move forgery detection: Survey, challenges and future directions10.1016/j.jnca.2016.09.008 ↗
5. A survey on deep learning-based image forgery detection10.1016/j.patcog.2023.109778 ↗
6. Bertalmio, M., Sapiro, G., Caselles, V., and Ballester, C. (2000, January 23–28). Image inpainting. Proceedings of the 27th Annual Conference on Computer Graphics and Interactive Techniques, New Orleans, LA, USA.10.1145/344779.344972 ↗
7. Popescu, A.C., and Farid, H. (2004). Exposing Digital Forgeries by Detecting Duplicated Image Regions, University of Califomia.
8. Exposing digital forgeries by detecting traces of resampling10.1109/TSP.2004.839932 ↗
9. Digital camera identification from sensor pattern noise10.1109/TIFS.2006.873602 ↗
10. Image tampering localization using a dense fully convolutional network10.1109/TIFS.2021.3070444 ↗
11. Wu, Y., AbdAlmageed, W., and Natarajan, P. (2019, January 18–20). Mantra-net: Manipulation tracing network for detection and localization of image forgeries with anomalous features. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.10.1109/CVPR.2019.00977 ↗
12. Toward effective image manipulation detection with proposal contrastive learning10.1109/TCSVT.2023.3247607 ↗
13. Wu, Y., Abd-Almageed, W., and Natarajan, P. (2018, January 8–14). Busternet: Detecting copy-move image forgery with source/target localization. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.10.1007/978-3-030-01231-1_11 ↗
14. Enhancing digital image forgery detection using transfer learning10.1109/ACCESS.2023.3307357 ↗
15. Zhou, P., Han, X., Morariu, V.I., and Davis, L.S. (2018, January 18–22). Learning rich features for image manipulation detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00116 ↗
16. Faster R-CNN: Towards real-time object detection with region proposal networks10.1109/TPAMI.2016.2577031 ↗
17. Mahfoudi, G., Tajini, B., Retraint, F., Morain-Nicolier, F., Dugelay, J.L., and Pic, M. (2019, January 2–6). Defacto: Image and face manipulation dataset. Proceedings of the 2019 27th European Signal Processing Conference (EUSIPCO), A Coruña, Spain.10.23919/EUSIPCO.2019.8903181 ↗
18. He, K., Rhemann, C., Rother, C., Tang, X., and Sun, J. (2011, January 20–25). A global sampling method for alpha matting. Proceedings of the CVPR 2011, Colorado Springs, CO, USA.10.1109/CVPR.2011.5995495 ↗
19. Tralic, D., Zupancic, I., Grgic, S., and Grgic, M. (2013, January 25–27). CoMoFoD—New database for copy-move forgery detection. Proceedings of the ELMAR-2013, Zadar, Croatia.
20. Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., and Zitnick, C.L. (2014, January 6–12). Microsoft coco: Common objects in context. Proceedings of the European Conference on Computer Vision, Zurich, Switzerland.10.1007/978-3-319-10602-1_48 ↗
21. Bi, X., and Liang, J. (2023). GreatSplicing: A Semantically Rich Splicing Dataset. arXiv.
22. Bas, P., Filler, T., and Pevný, T. (2011, January 18–20). “Break our steganographic system”: The ins and outs of organizing BOSS. Proceedings of the International Workshop on Information Hiding, Prague, Czech Republic.10.1007/978-3-642-24178-9_5 ↗
23. Daisy, M., Buyssens, P., Tschumperlé, D., and Lézoray, O. (2014, January 27–30). A smarter exemplar-based inpainting algorithm using local and global heuristics for more geometric coherence. Proceedings of the 2014 IEEE International Conference on Image Processing (ICIP), Paris, France.10.1109/ICIP.2014.7025937 ↗
24. Tan, M., and Le, Q. (2019, January 9–15). Efficientnet: Rethinking model scaling for convolutional neural networks. Proceedings of the International Conference on Machine Learning, Long Beach, CA, USA.
25. Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., and Fei-Fei, L. (2009, January 20–25). Imagenet: A large-scale hierarchical image database. Proceedings of the 2009 IEEE Conference on Computer Vision and Pattern Recognition, Miami Beach, FL, USA.10.1109/CVPR.2009.5206848 ↗
26. Ronneberger, O., Fischer, P., and Brox, T. (2015, January 5–9). U-net: Convolutional networks for biomedical image segmentation. Proceedings of the International Conference on Medical Image Computing and Computer-Assisted Intervention, Munich, Germany.10.1007/978-3-319-24574-4_28 ↗
27. Rich models for steganalysis of digital images10.1109/TIFS.2012.2190402 ↗
28. Dropout: A simple way to prevent neural networks from overfitting