journal article·2023-07-09Open access

FC-ResNet: A Multilingual Handwritten Signature Verification Model Using an Improved ResNet with CBAM

Yusnur Muhtar, Mahpirat Muhammat, Nurbiya Yadikar, Alimjan Aysa, Kurban Ubul

Applied Sciences· Volume 13· Issue 14

Abstract

Offline signature verification is a widely used biometric method in finance, law, and administrative procedures. However, existing deep convolutional neural network models perform poorly on signature datasets that span different regions and ethnic people, while also suffering from problems such as large parameter counts and slow inference speeds. To address these issues, we propose an improved residual network model (FC-ResNet). This model introduces a convolutional block attention module into the classical residual network to adapt to the diversity and variability of signatures, while also compressing the model for lightweight deployment. Due to the lack of public, offline handwritten signature datasets for ethnic people, we collected a large-scale offline handwritten signature dataset, including genuine signatures and forged signatures in Chinese, Uyghur, Kazakh, and Kirgiz, totaling 38,400 images. Our FC-ResNet model achieved an accuracy of over 96% for each language in our self-built dataset, as well as accuracy rates of 96.21%, 98.42%, and 97.28% on the public datasets CEDAR, BHSig-B, and BHSig-H, respectively. Based on the above experimental results, our proposed model demonstrates great potential for both public and self-built signature datasets, while also exhibiting significant advantages in lightweight model deployment. We believe that this work can provide a feasible solution for ethnic people signature verification.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Handwritten Text Recognition Techniques · Vehicle License Plate Recognition · Advanced Neural Network Applications

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Information Science and Engineering, Xinjiang University, Urumqi 830046, China

Institue of International Culture and Exchange, Xinjiang University, Urumqi 830046, China

Key Laboratory of Xinjiang Multilingual Information Processing, Urumqi 830046, China

Funding

National Natural Science Foundation of China · Science and Technology Plan Project of Xinjiang Uyghur Autonomous Region, China

References (40)

Show source-provided references
1. Hafemann, L.G., Sabourin, R., and Oliveira, L.S. (December, January 28). Offline handwritten signature verification—Literature review. Proceedings of the Seventh International Conference on Image Processing Theory, Tools and Applications (IPTA), Montreal, QU, Canada.
2. A perspective analysis of handwritten signature technology10.1145/3274658 ↗
3. Machine learning-based offline signature verification systems: A systematic review10.1016/j.image.2021.116139 ↗
4. Muhtar, Y., Kang, W., Rexit, A., and Ubul, K. (2022, January 15–17). A Survey of Offline Handwritten Signature Verification Based on Deep Learning. Proceedings of the 3rd International Conference on Pattern Recognition and Machine Learning (PRML), Chengdu, China.10.1109/PRML56267.2022.9882188 ↗
5. Signature identification and verification techniques: State-of-the-art work10.1007/s12652-021-03356-w ↗
6. Offline signature verification and identification using distance statistics10.1142/S0218001404003630 ↗
7. Fierrez-Aguilar, J., Nanni, L., Lopez-Penalba, J., Ortega-Garcia, J., and Maltoni, D. (2005, January 20–22). An on-line signature verification system based on fusion of local and global information. Proceedings of the Audio-and Video-Based Biometric Person Authentication: 5th International Conference, AVBPA, Hilton Rye Town, NY, USA.10.1007/11527923_54 ↗
8. Pal, S., Alaei, A., Pal, U., and Blumenstein, M. (2016, January 11–14). Performance of an off-line signature verification method based on texture features on a large indic-script signature dataset. Proceedings of the 12th IAPR Workshop on Document Analysis Systems (DAS), Santorini, Greece.10.1109/DAS.2016.48 ↗
9. Offline geometric parameters for automatic signature verification using fixed-point arithmetic10.1109/TPAMI.2005.125 ↗
10. Ferrer, M.A., Diaz-Cabrera, M., and Morales, A. (2013, January 4–7). Synthetic off-line signature image generation. Proceedings of the International Conference on Biometrics (ICB), Madrid, Spain.10.1109/ICB.2013.6612969 ↗
11. Yilmaz, M.B., Yanikoglu, B., Tirkaz, C., and Kholmatov, A. (2011, January 11–13). Offline signature verification using classifier combination of HOG and LBP features. Proceedings of the International Joint Conference on BIOMETRICS (IJCB), Washington, DC, USA.10.1109/IJCB.2011.6117473 ↗
12. Serdouk, Y., Nemmour, H., and Chibani, Y. (2014, January 23–27). Combination of OC-LBP and longest run features for off-line signature verification. Proceedings of the Tenth International Conference on Signal-Image Technology and Internet-Based Systems, Marrakech, Morocco.10.1109/SITIS.2014.36 ↗
13. Handwritten signature verification using the quad-tree histogram of templates and a support vector-based artificial immune classification10.1016/j.imavis.2017.08.004 ↗
14. Batool, F.E., Attique, M., Sharif, M., Javed, K., Nazir, M., Abbasi, A.A., Iqbal, Z., and Riaz, N. (2020). Offline signature verification system: A novel technique of fusion of GLCM and geometric features using SVM. Multimed. Tools Appl.10.1007/s11042-020-08851-4 ↗
15. Dey, S., Dutta, A., Toledo, J.I., Ghosh, S.K., Lladós, J., and Pal, U. (2017). Signet: Convolutional siamese network for writer independent offline signature verification. arXiv.
16. Patch-based offline signature verification using one-class hierarchical deep learning10.1007/s10032-019-00331-2 ↗
17. Wei, P., Li, H., and Hu, P. (2019, January 15–20). Inverse discriminative networks for handwritten signature verification. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.10.1109/CVPR.2019.00591 ↗
18. Zois, E.N., Zervas, E., Tsourounis, D., and Economou, G. (2020, January 13–19). Sequential motif profiles and topological plots for offline signature verification. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.10.1109/CVPR42600.2020.01326 ↗
19. Souza, V.L., Oliveira, A.L., Cruz, R.M., and Sabourin, R. (2021, January 10–15). An investigation of feature selection and transfer learning for writer-independent offline handwritten signature verification. Proceedings of the 2020 25th International Conference on Pattern Recognition (ICPR), Milan, Italy.10.1109/ICPR48806.2021.9413073 ↗
20. Offline signature verification using a region based deep metric learning network10.1016/j.patcog.2021.108009 ↗
21. A Recurrent Neural Network based deep learning model for offline signature verification and recognition system10.1016/j.eswa.2020.114249 ↗
22. Offline signature verification system: A graph neural network based approach10.1007/s12652-021-03592-0 ↗
23. Cbcapsnet: A novel writer-independent offline signature verification model using a cnn-based architecture and capsule neural networks10.1016/j.eswa.2021.115649 ↗
24. Chattopadhyay, S., Manna, S., Bhattacharya, S., and Pal, U. (2022, January 21–25). SURDS: Self-Supervised Attention-guided Reconstruction and Dual Triplet Loss for Writer Independent Offline Signature Verification. Proceedings of the 26th International Conference on Pattern Recognition (ICPR), Montreal, QU, Canada.10.1109/ICPR56361.2022.9956442 ↗
25. He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27–30). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.10.1109/CVPR.2016.90 ↗
26. Woo, S., Park, J., Lee, J.Y., and Kweon, I.S. (2018, January 14–17). Cbam: Convolutional block attention module. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.10.1007/978-3-030-01234-2_1 ↗
27. Bagherinezhad, H., Rastegari, M., and Farhadi, A. (2017, January 21–26). Lcnn: Lookup-based convolutional neural network. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.98 ↗
28. Rastegari, M., Ordonez, V., Redmon, J., and Farhadi, A. (2016, January 11–14). Xnor-net: Imagenet classification using binary convolutional neural networks. Proceedings of the Computer Vision–ECCV 2016: 14th European Conference, Amsterdam, The Netherlands. Proceedings, Part IV.10.1007/978-3-319-46493-0_32 ↗
29. Jaderberg, M., Vedaldi, A., and Zisserman, A. (2014). Speeding up convolutional neural networks with low rank expansions. arXiv.10.5244/C.28.88 ↗
30. He, Y., Zhang, X., and Sun, J. (2017, January 22–29). Channel pruning for accelerating very deep neural networks. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.10.1109/ICCV.2017.155 ↗
31. Offline signature verification and quality characterization using poset-oriented grid features10.1016/j.patcog.2016.01.009 ↗
32. Writer-independent off-line signature verification using surroundedness feature10.1016/j.patrec.2011.10.009 ↗
33. Li, C., Lin, F., Wang, Z., Yu, G., Yuan, L., and Wang, H. (2019, January 20–25). DeepHSV: User-independent offline signature verification using two-channel CNN. Proceedings of the 2019 International Conference on Document Analysis and Recognition (ICDAR), Sydney, Australia.10.1109/ICDAR.2019.00035 ↗
34. Learning features for offline handwritten signature verification using deep con-volutional neural networks10.1016/j.patcog.2017.05.012 ↗
35. Lu, X., Huang, L., and Yin, F. (2021, January 10–15). Cut and compare: End-to-end offline signature verification network. Proceedings of the 2020 25th International Conference on Pattern Recognition (ICPR), Milan, Italy.10.1109/ICPR48806.2021.9412377 ↗
36. Avn: An adversarial variation network model for handwritten signature verification10.1109/TMM.2021.3056217 ↗
37. Signature verification using geometrical features and artificial neural network classifier10.1007/s00521-020-05473-7 ↗
38. Xamxidin, N., Mahpirat Yao, Z., Aysa, A., and Ubul, K. (2022). Multilingual Offline Signature Verification Based on Improved Inverse Discriminator Network. Information, 13.10.3390/info13060293 ↗
39. Zhang, X., Wu, Z., Xie, L., Li, Y., Li, F., and Zhang, J. (2022, January 11–13). Multi-Path Siamese Convolution Network for Offline Handwritten Signature Verification. Proceedings of the 2022 the 8th International Conference on Computing and Data Engineering, Bangkok, Thailand.10.1145/3512850.3512854 ↗
40. Multi-scripted Writer Independent Off-line Signature Verification using Convolutional Neural Network10.1007/s11042-022-13392-z ↗