journal article·2025-04-14Open access

Visual Complexity in Korean Documents: Toward Language-Specific Datasets for Deep Learning-Based Forgery Detection

Yong-Yeol Bae, Dae-Jea Cho, Ki-Hyun Jung

Applied Sciences· Volume 15· Issue 8

Abstract

Recent advancements in information and communication technology have driven various organizations, including businesses, government agencies, and institutions, to digitize and manage critical documents. Document digitization mitigates spatial constraints on storage and offers significant advantages in transmission and management. However, while digitization offers many benefits, the development of image processing software has also increased the risk of forgery and manipulation of digital documents. Digital documents, ranging from everyday documents to those handled by major institutions, can become targets of forgery, and the unrestricted distribution of such documents may cause social disruption. As a result, research on digital document forgery detection has been actively conducted in various countries, with recent studies focusing on improving detection accuracy using deep learning techniques. However, most of the document image datasets generated for the development of deep learning models are English-based documents. Consequently, forgery detection models trained on these English-based datasets may perform well on English documents but may not achieve the same level of accuracy when applied to documents in other languages. This study systematically examines the necessity of language-specific datasets by analyzing the impact of visual complexity on forgery detection accuracy. Specifically, this study analyzes differences in forgery characteristics between English and Korean documents as representative cases and evaluates the classification performance of a forgery detection model trained on an English dataset when applied to both English and Korean documents. The experimental results indicate that forged document images exhibit distinct visual alterations depending on the language. Furthermore, the detection performance of models trained on English-based datasets varies according to the language of the training and test data. These findings underscore the necessity of developing datasets and model architectures tailored to the linguistic and structural characteristics of each language to enhance forgery detection efficacy. Additionally, the results highlight the importance of multilingual datasets in deep learning-based forgery detection, providing a foundation for the advancement of language-specific detection models.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Digital Media Forensic Detection · Handwritten Text Recognition Techniques · Adversarial Robustness in Machine Learning

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Software Convergence, Gyeongkuk National University (Andong National University), Andong 36729, Republic of Korea

Funding

Ministry of Education

References (29)

Show source-provided references
1. Hamido, M., Mohialdin, A., and Atia, A. (2023, January 20–23). The Use of Background Features, Template Synthesis and Deep Neural Networks in Document Forgery Detection. Proceedings of the 2023 International Conference on Artificial Intelligence in Information and Communication (ICAIIC), Bali, Indonesia.10.1109/ICAIIC57133.2023.10067120 ↗
2. Deep Feature Extraction for Document Forgery Detection with Convolutional Autoencoders10.1016/j.compeleceng.2022.107770 ↗
3. Tornés, B.M., Taburet, T., Boros, E., Rouis, K., Doucet, A., Gomez-Krämer, P., Sidere, N., and d’Andecy, V.P. (2023, January 21–26). Receipt Dataset for Document Forgery Detection. Proceedings of the 2023 17th International Conference on Document Analysis and Recognition (ICDAR), San José, CA, USA.10.1007/978-3-031-41682-8_28 ↗
4. Qu, C., Liu, J., Zhang, H., Chen, Y., Wu, Y., Li, X., and Yang, F. (2023, January 17–24). Towards Robust Tampered Text Detection in Document Image: New Dataset and New Solution. Proceedings of the 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Vancouver, BC, Canada.10.1109/CVPR52729.2023.00575 ↗
5. An Efficient Technique for Detecting Document Forgery in Hyperspectral Document Images10.1016/j.aej.2023.11.040 ↗
6. Boonkrong, S. (2024). Design of an Academic Document Forgery Detection System. Int. J. Inf. Technol., 1–13.10.1007/s41870-024-02006-6 ↗
7. Forged Document Detection and Writer Identification Through Unsupervised Deep Learning Approach10.1007/s11042-023-16146-7 ↗
8. Jaiswal, A.K., Singh, S., and Tripathy, S.K. (2023, January 6–8). FSD: A Novel Forged Document Dataset and Baseline. Proceedings of the 2023 14th International Conference on Computing Communication and Networking Technologies (ICCCNT), Delhi, India.10.1109/ICCCNT56998.2023.10306408 ↗
9. Tornés, B.M., Boros, E., Doucet, A., Gomez-Krämer, P., and Ogier, J.M. (2023, January 21–26). Detecting Forged Receipts with Domain-Specific Ontology-Based Entities & Relations. Proceedings of the Document Analysis and Recognition—ICDAR 2023, San José, CA, USA. Lecture Notes in Computer Science.10.1007/978-3-031-41682-8_12 ↗
10. Dash, R., Bag, M., Pattnayak, D., Mohanty, A., and Dash, I. (2023, January 17–18). Automated Signature Inspection and Forgery Detection Utilizing VGG-16: A Deep Convolutional Neural Network. Proceedings of the 2023 2nd International Conference on Ambient Intelligence in Health Care (ICAIHC), Bhubaneswar, India.10.1109/ICAIHC59020.2023.10431430 ↗
11. Ebrahimpour, N. (2023, January 20–21). Handwritten Signatures Forgery Detection Using Pre-Trained Deep Learning Methods. Proceedings of the 2nd International Congress of New Horizons in Sciences, İstanbul, Türkiye.
12. Zaman, Z., Ahmed, S.B., and Malik, M.I. (2023). Analysis of Hyperspectral Data to Develop an Approach for Document Images. Sensors, 23.10.3390/s23156845 ↗
13. Document Image Forgery and Detection Methods Using Image Processing Techniques—A Review
14. Kleber, F., Fiel, S., Diem, M., and Sablatnig, R. (2013, January 25–28). CVL-DataBase: An Off-Line Database for Writer Retrieval, Writer Identification and Word Spotting. Proceedings of the 2013 12th International Conference on Document Analysis and Recognition, Washington, DC, USA.10.1109/ICDAR.2013.117 ↗
15. Shahab, A., Shafait, F., and Dengel, A. (2011, January 18–21). ICDAR 2011 Robust Reading Competition Challenge 2: Reading Text in Scene Images. Proceedings of the 2011 International Conference on Document Analysis and Recognition, Beijing, China.10.1109/ICDAR.2011.296 ↗
16. KHATT: An open Arabic offline handwritten text database10.1016/j.patcog.2013.08.009 ↗
17. Artaud, C., Sidère, N., Doucet, A., Ogier, J.-M., and Yooz, V.P.D. (2018, January 20–24). Find it! Fraud Detection Contest Report. Proceedings of the 2018 24th International Conference on Pattern Recognition (ICPR), Beijing, China.10.1109/ICPR.2018.8545428 ↗
18. Shivakumara, P., Basavaraja, V., Gowda, H.S., Guru, D.S., Pal, U., and Lu, T. (2018, January 5–8). A New RGB Based Fusion for Forged IMEI Number Detection in Mobile Images. Proceedings of the 2018 16th International Conference on Frontiers in Handwriting Recognition (ICFHR), Niagara Falls, NY, USA.10.1109/ICFHR-2018.2018.00074 ↗
19. Halder, B., and Garain, U. (2010, January 23–26). Color Feature Based Approach for Determining Ink Age in Printed Documents. Proceedings of the 2010 20th International Conference on Pattern Recognition, Istanbul, Turkey.10.1109/ICPR.2010.785 ↗
20. Graphic Complexity in Writing Systems10.1016/j.cognition.2021.104771 ↗
21. Multispectral Image Matching Using SIFT and SURF Algorithm: A Review
22. Document Image Forgery Detection Using RGB Color Channel
23. Image Forgery Detection: A Survey of Recent Deep-Learning Approaches10.1007/s11042-022-13797-w ↗
24. Textural Features for Image Classification10.1109/TSMC.1973.4309314 ↗
25. FAST, BRIEF and SIFT Based Image Copy-Move Forgery Detection Technique10.1007/s11042-022-12915-y ↗
26. Distinctive Image Features from Scale-Invariant Keypoints10.1023/B:VISI.0000029664.99615.94 ↗
27. Kohavi, R. (1995, January 20–25). A study of cross-validation and bootstrap for accuracy estimation and model selection. Proceedings of the 14th International Joint Conference on Artificial Intelligence, Montreal, QC, Canada.
28. Lu, Y., Vincent, N., Yuen, P.C., Zheng, W.S., Cheriet, F., and Suen, C.Y. A New Method for Detecting Altered Text in Document Images. Proceedings of the Pattern Recognition and Artificial Intelligence, ICPRAI 2020, Zhongshan, China, 19–23 October 2020, Lecture Notes in Computer Science.10.1007/978-3-030-59830-3 ↗
29. MIDV-2020: A Comprehensive Benchmark Dataset for Identity Document Analysis10.18287/2412-6179-CO-1006 ↗