journal article·2024-11-07Open access

Handwritten Signature Generation Using Denoising Diffusion Probabilistic Models with Auxiliary Classification Processes

Dong-Jin Hong, Won-Du Chang, Eui-Young Cha

Applied Sciences· Volume 14· Issue 22

Abstract

Automatic signature verification has been widely studied for authentication purposes in real life, but limited data availability still poses a significant challenge. To address this issue, we propose a method with a denoising diffusion probabilistic model (DDPM) to generate artificial signatures that closely resemble authentic ones. In the proposed method, we modified the noise prediction process of the DDPM to allow the generation of signatures specific to certain classes. We also employed an auxiliary classification process to ensure that the generated signatures closely resemble the originals. The model was trained and evaluated using the CEDAR signature dataset, a widely used collection of offline handwritten signatures for signature verification research. The results indicate that the generated signatures exhibited a high similarity to the originals, with an average structural similarity index (SSIM) of 0.9806 and a root mean square error (RMSE) of 0.1819. Furthermore, when the generated signatures were added to the training data and the signature verification model was retrained and validated, the model achieved an accuracy of 94.87% on the test data, representing an improvement of 0.061 percentage points compared to training on only the original dataset. These results indicate that the generated signatures reflect the diversity that original signatures may exhibit and that the generated data can enhance the performance of verification systems. The proposed method introduces a novel approach to utilizing DDPM for signature data generation and demonstrates that the auxiliary classification process can reduce the likelihood of generated data being mistaken for forged signatures.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Handwritten Text Recognition Techniques · Image Processing and 3D Reconstruction · Text and Document Classification Technologies

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Information Convergence Engineering Department, Pusan National University, 2 Busandaehak-ro 63beon-gil, Geumjeong-gu, Busan 46241, Republic of Korea

Department of Artificial Intelligence Convergence, Pukyong National University, Yongso-ro 45, Nam-gu, Busan 48513, Republic of Korea

Funding

National Research Foundation of Korea (NRF) · INNOPOLIS Foundation

References (32)

Show source-provided references
1. HMM-based on-line signature verification: Feature extraction and signature modeling10.1016/j.patrec.2007.07.012 ↗
2. Offline signature verification using shape correspondence
3. Synergy of foreground-background images for feature extraction: Offline signature verification using Fisher vector with fused KAZE features10.1016/j.patcog.2018.02.027 ↗
4. A framework for offline signature verification system: Best features selection approach10.1016/j.patrec.2018.01.021 ↗
5. A Recurrent Neural Network based deep learning model for offline signature verification and recognition system10.1016/j.eswa.2020.114249 ↗
6. A Handwritten signature verification using shallow convolutional neural network10.1007/s11042-020-08728-6 ↗
7. Wei, P., Li, H., and Hu, P. (2019, January 16–20). Inverse Discriminative Networks for Handwritten Signature Verification. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.10.1109/CVPR.2019.00591 ↗
8. Offline signature verification system with Gaussian mixture models (GMM)10.24297/ijct.v10i6.3196 ↗
9. Offline signature verification using a region based deep metric learning network10.1016/j.patcog.2021.108009 ↗
10. OSVFuseNet: Online Signature Verification by feature fusion and depth-wise separable convolution based deep learning10.1016/j.neucom.2020.05.072 ↗
11. Anmol, C., Vansh, J., and Rajas, B. (2023, January 7–9). SigScatNet: A Siamese + Scattering based Deep Learning Approach for Signature Forgery Detection and Similarity Assessment. Proceedings of the 2023 International Conference on Modeling, Simulation & Intelligent Computing, Dubai, United Arab Emirates.
12. Jaouhar, F., Feriel, S., Mohamed, M., Ridha, G., Emil, P., and Baha, E.L. (2024, January 1–4). Handwritten Signature Recognition using Parallel CNNs and Transfer Learning for Forensics. Proceedings of the 2024 10th International Conference on Control, Decision and Information Technologies (CoDIT), Vallette, Malta.
13. Sudharshan, D.P., and Vismaya, R.N. (2022, January 29–30). Handwritten signature verification system using deep learning. Proceedings of the 2022 IEEE International Conference on Data Science and Information System (ICDSIS), Hassan, India.10.1109/ICDSIS55133.2022.9915833 ↗
14. AVN: An Adversarial Variation Network Model for Handwritten Signature Verification10.1109/TMM.2021.3056217 ↗
15. Offline signature verification using a region based deep metric learning network
16. Gupta, Y., Kulkarni, S., and Jain, P. (2021, January 16–18). Handwritten signature verification using transfer learning and data augmentation. Proceedings of the International Conference on Intelligent Cyber-Physical Systems, Jaipur, India.10.1007/978-981-16-7136-4_19 ↗
17. Impact of augmentation methods in online signature verification10.1007/s11334-022-00464-4 ↗
18. Intrapersonal parameter optimization for offline handwritten signature augmentation10.1109/TIFS.2020.3033442 ↗
19. Galbally, J., Fierrez, J., Martinez, M., and Ortega, J. (2009, January 5). Synthetic generation of handwritten signatures based on spectral analysis. Proceedings of the Optics and Photonics in Global Homeland Security V and Biometric Technology for Human Identification VI, Orlando, FL, USA.10.1117/12.817928 ↗
20. A new synthetic feature generation scheme based on artificial immune systems for robust offline signature verification10.1016/j.eswa.2022.119306 ↗
21. Generation of Synthesis Handwritten Signatures Using Image Processing Techniques for Biometrics
22. OffSig-Sin GAN: A Deep Learning-Based Image Augmentation Model for Offline Signature Verification
23. Denoising diffusion probabilistic models
24. (2024, November 05). CEDAR Signature Database. Available online: http://www.cedar.buffalo.edu/NIJ/data/signatures.rar.
25. Ronneberger, O., Fischer, P., and Brox, T. (2015, January 5–9). U-net: Convolutional networks for biomedical image segmentation. Proceedings of the Medical Image Computing and Computer-Assisted Intervention–MICCAI 2015: 18th International Conference, Munich, Germany.10.1007/978-3-319-24574-4_28 ↗
26. Huang, G., Liu, Z., Van, D.M.L., and Weinberger, K.Q. (2017, January 21–26). Densely connected convolutional networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.243 ↗
27. Shaw, P., Uszkoreit, J., and Vaswani, A. (2018). Self-attention with relative position representations. arXiv.10.18653/v1/N18-2074 ↗
28. Leedham, G., Chen, Y.A.N., Takru, K., Tan, J.H.N., and Mian, L. (2003, January 3). Comparison of Some Thresholding Algorithms for Text/Background Segmentation in Difficult Document Images. Proceedings of the Seventh International Conference on Document Analysis and Recognition, Edinburgh, UK.
29. Sevilla, L., Sun, D., Jampani, V., and Black, M.J. (2016, January 27–30). Optical flow with semantic segmentation and localized layers. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.
30. The discrete wavelet transform: Wedding the a trous and Mallat algorithms10.1109/78.157290 ↗
31. Kingma, D.P. (2014). Adam: A method for stochastic optimization. arXiv.
32. Nonlinear systems modelling based on self-organizing fuzzy neural network with hierarchical pruning scheme10.1016/j.asoc.2020.106516 ↗