A Riemannian Dichotomizer Approach on Symmetric Positive Definite Manifolds for Offline, Writer-Independent Signature Verification
Source abstract
Abstract
Automated handwritten signature verification continues to pose significant challenges. A common approach for developing writer-independent signature verifiers involves the use of a dichotomizer, a function that generates a dissimilarity vector with the differences between similar and dissimilar pairs of signature descriptors as components. The Dichotomy Transform was applied within a Euclidean or vector space context, where vectored representations of handwritten signatures were embedded in and conformed to Euclidean geometry. Recent advances in computer vision indicate that image representations to the Riemannian Symmetric Positive Definite (SPD) manifolds outperform vector space representations. In offline signature verification, both writer-dependent and writer-independent systems have recently begun leveraging Riemannian frameworks in the space of SPD matrices, demonstrating notable success. This work introduces, for the first time in the signature verification literature, a Riemannian dichotomizer employing Riemannian dissimilarity vectors (RDVs). The proposed framework explores a number of local and global (or common pole) topologies, as well as simple serial and parallel fusion strategies for RDVs for constructing robust models. Experiments were conducted on five popular signature datasets of Western and Asian origin, using blind intra- and cross-lingual experimental protocols. The results indicate the discriminative capabilities of the proposed Riemannian dichotomizer framework, which can be compared to other state-of-the-art and computationally demanding architectures.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Handwritten Text Recognition Techniques · Natural Language Processing Techniques · Image Processing and 3D Reconstruction
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Telecommunications, Signal Processing and Intelligent Systems Laboratory (Telsip), Ancient Olive Grove Campus, University of West Attica, 12241 Aigaleo, Greece
References (83)
Show source-provided references
1. Biometrics: Trust, But Verify10.1109/TBIOM.2021.3115465 ↗
2. A comprehensive survey on the biometric recognition systems based on physiological and behavioral modalities10.1016/j.eswa.2019.113114 ↗
3. Machine learning-based offline signature verification systems: A systematic review10.1016/j.image.2021.116139 ↗
4. Interpol questioned documents review 2019–202210.1016/j.fsisyn.2022.100300 ↗
5. Exploring offline signature verification techniques: A survey based on methods and future directions10.1007/s11042-024-20454-x ↗
6. A Perspective Analysis of Handwritten Signature Technology10.1145/3274658 ↗
7. Engin, D., Kantarcı, A., Arslan, S., and Ekenel, H.K. (2020, January 14–19). Offline Signature Verification on Real-World Documents. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, Seattle, WA, USA.10.1109/CVPRW50498.2020.00412 ↗
8. Bromley, J., Guyon, I., LeCun, Y., Säckinger, E., and Shah, R. (December, January 29). Signature verification using a “siamese” time delay neural network. Proceedings of the Advances in Neural Information Processing Systems (NIPS 1993), Denver, CO, USA.10.1142/9789812797926_0003 ↗
9. Impedovo, D., Pirlo, G., and Plamondon, R. (2012, January 18–20). Handwritten Signature Verification: New Advancements and Open Issues. Proceedings of the 2012 International Conference on Frontiers in Handwriting Recognition, Bari, Italy.10.1109/ICFHR.2012.211 ↗
10. Stauffer, M., Maergner, P., Fischer, A., and Riesen, K. (2021). A Survey of State of the Art Methods Employed in the Offline Signature Verification Process. New Trends in Business Information Systems and Technology: Digital Innovation and Digital Business Transformation, Springer.10.1007/978-3-030-48332-6_2 ↗
11. Automatic signature verification in the mobile cloud scenario: Survey and way ahead10.1109/TETC.2018.2865345 ↗
12. Handwriting Biometrics: Applications and Future Trends in e-Security and e-Health10.1007/s12559-020-09755-z ↗
13. SynSig2Vec: Forgery-Free Learning of Dynamic Signature Representations by Sigma Lognormal-Based Synthesis and 1D CNN10.1109/TPAMI.2021.3087619 ↗
14. Online signature verification using single-template matching with time-series averaging and gradient boosting10.1016/j.patcog.2020.107227 ↗
15. Vorugunti, C.S., Guru, D.S., Mukherjee, P., and Pulabaigari, V. (2019, January 20–25). OSVNet: Convolutional Siamese Network for Writer Independent Online Signature Verification. Proceedings of the 2019 International Conference on Document Analysis and Recognition (ICDAR), Sydney, Australia.10.1109/ICDAR.2019.00236 ↗
16. Online signature verification by continuous wavelet transformation of speed signals10.1016/j.eswa.2018.03.023 ↗
17. Preprocessing and Feature Selection for Improved Sensor Interoperability in Online Biometric Signature Verification10.1109/ACCESS.2015.2431493 ↗
18. Shih, M.-C., Huang, T.-L., Shih, Y.-H., Shuai, H.-H., Liu, H.-T., Yeh, Y.-R., and Huang, C.-C. (October, January 29). DetailSemNet: Elevating Signature Verification Through Detail-Semantic Integration. Proceedings of the European Conference on Computer Vision (ECCV), Milan, Italy.
19. TransOSV: Offline Signature Verification with Transformers10.1016/j.patcog.2023.109882 ↗
20. A Signature Recognition Technique with a Powerful Verification Mechanism Based on CNN and PCA10.1109/ACCESS.2024.3377455 ↗
21. A multi-task approach for contrastive learning of handwritten signature feature representations10.1016/j.eswa.2023.119589 ↗
22. Offline handwritten mathematical recognition using adversarial learning and transformers10.1007/s10032-023-00451-w ↗
23. HTCSigNet: A Hybrid Transformer and Convolution Signature Network for offline signature verification10.1016/j.patcog.2024.111146 ↗
24. A new synthetic feature generation scheme based on artificial immune systems for robust offline signature verification10.1016/j.eswa.2022.119306 ↗
25. Muhtar, Y., Muhammat, M., Yadikar, N., Aysa, A., and Ubul, K. (2023). FC-ResNet: A Multilingual Handwritten Signature Verification Model Using an Improved ResNet with CBAM. Appl. Sci., 13.10.3390/app13148022 ↗
26. Intrapersonal Parameter Optimization for Offline Handwritten Signature Augmentation10.1109/TIFS.2020.3033442 ↗
27. Generation of Duplicated Off-Line Signature Images for Verification Systems10.1109/TPAMI.2016.2560810 ↗
28. Multi-feature extraction and selection in writer-independent off-line signature verification10.1007/s10032-011-0180-6 ↗
29. Hybrid writer-independent writer-dependent offline signature verification system10.1049/iet-bmt.2013.0024 ↗
30. A white-box analysis on the writer-independent dichotomy transformation applied to offline handwritten signature verification10.1016/j.eswa.2020.113397 ↗
31. Writer independent handwritten signature verification on multi-scripted signatures using hybrid CNN-BiLSTM: A novel approach10.1016/j.eswa.2022.119111 ↗
32. High discriminant features for writer-independent online signature verification10.1007/s11042-023-14638-0 ↗
33. Writer-independent signature verification; Evaluation of robotic and generative adversarial attacks10.1016/j.ins.2023.03.029 ↗
34. Manna, S., Chattopadhyay, S., Bhattacharya, S., and Pal, U. (2022, January 16–19). SWIS: Self-Supervised Representation Learning for Writer Independent Offline Signature Verification. Proceedings of the 2022 IEEE International Conference on Image Processing (ICIP), Bordeaux, France.10.1109/ICIP46576.2022.9897562 ↗
35. Chattopadhyay, S., Manna, S., Bhattacharya, S., and Pal, U. (2022, January 21–25). SURDS: Self-Supervised Attention-guided Reconstruction and Dual Triplet Loss for Writer Independent Offline Signature Verification. Proceedings of the 2022 26th International Conference on Pattern Recognition (ICPR), Montreal, QC, Canada.10.1109/ICPR56361.2022.9956442 ↗
36. CBCapsNet: A novel writer-independent offline signature verification model using a CNN-based architecture and capsule neural networks10.1016/j.eswa.2021.115649 ↗
37. Writer independent offline signature verification based on asymmetric pixel relations and unrelated training-testing datasets10.1016/j.eswa.2019.01.058 ↗
38. Galbally, J., Gomez-Barrero, M., and Ross, A. (2017, January 1–4). Accuracy evaluation of handwritten signature verification: Rethinking the random-skilled forgeries dichotomy. Proceedings of the 2017 IEEE International Joint Conference on Biometrics (IJCB), Denver, CO, USA.10.1109/BTAS.2017.8272711 ↗
39. Santos, C., Justino, E.J.R., Bortolozzi, F., and Sabourin, R. (2004, January 26–29). An off-line signature verification method based on the questioned document expert’s approach and a neural network classifier. Proceedings of the Ninth International Workshop on Frontiers in Handwriting Recognition, Kokubunji, Japan.
40. Oliveira, L., Justino, E., and Sabourin, R. (2007, January 12–17). Off-line Signature Verification Using Writer-Independent Approach. Proceedings of the 2007 International Joint Conference on Neural Networks, Orlando, FL, USA.10.1109/IJCNN.2007.4371358 ↗
41. Reducing forgeries in writer-independent off-line signature verification through ensemble of classifiers10.1016/j.patcog.2009.05.009 ↗
42. Eskander, G.S., Sabourin, R., and Granger, E. (2012, January 18–20). Adaptation of Writer-Independent Systems for Offline Signature Verification. Proceedings of the 2012 International Conference on Frontiers in Handwriting Recognition, Bari, Italy.10.1109/ICFHR.2012.175 ↗
43. 2C2S: A two-channel and two-stream transformer based framework for offline signature verification10.1016/j.engappai.2022.105639 ↗
44. Lu, X., Huang, L., and Yin, F. (2021, January 10–15). Cut and Compare: End-to-end Offline Signature Verification Network. Proceedings of the 2020 25th International Conference on Pattern Recognition (ICPR), Milan, Italy.10.1109/ICPR48806.2021.9412377 ↗
45. Wei, P., Li, H., and Hu, P. (2019, January 15–20). Inverse Discriminative Networks for Handwritten Signature Verification. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.10.1109/CVPR.2019.00591 ↗
46. Dey, S., Dutta, A., Toledo, J.I., Ghosh, S.K., Lladós, J., and Pal, U. (2017). SigNet: Convolutional Siamese Network for Writer Independent Offline Signature Verification. arXiv.
47. Writer Identification: Statistical Analysis and Dichotomizer
48. Pekalska, E., and Duin, R.P.W. (2006, January 20–24). Dissimilarity-based classification for vectorial representations. Proceedings of the 18th International Conference on Pattern Recognition (ICPR’06), Hong Kong, China.10.1109/ICPR.2006.457 ↗
49. Beyond Traditional Kernels: Classification in Two Dissimilarity-Based Representation Spaces10.1109/TSMCC.2008.2001687 ↗
50. Feature-Based Dissimilarity Space Classification10.1007/978-3-642-17711-8_5 ↗
51. A Comprehensive Look at Coding Techniques on Riemannian Manifolds10.1109/TNNLS.2018.2812799 ↗
52. Subscripto multiplex: A Riemannian symmetric positive definite strategy for offline signature verification10.1016/j.patrec.2023.02.002 ↗
53. Giazitzis, A., Diaz, M., Zois, E.N., and Ferrer, M.A. (September, January 30). Janus-Faced Handwritten Signature Attack: A Clash Between a Handwritten Signature Duplicator and a Writer Independent, Metric Meta-learning Offline Signature Verifier. Proceedings of the 18th International Conference on Document Analysis and Recognition, Athens, Greece.
54. Giazitzis, A., and Zois, E.N. (2024, January 3–8). SigmML: Metric meta-learning for Writer Independent Offline Signature Verification in the Space of SPD Matrices. Proceedings of the 2024 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), Waikoloa, HI, USA.10.1109/WACV57701.2024.00619 ↗
55. Similarity Distance Learning on SPD Manifold for Writer Independent Offline Signature Verification10.1109/TIFS.2023.3333681 ↗
56. Metric meta-learning and intrinsic Riemannian embedding for writer independent offline signature verification10.1016/j.eswa.2024.125470 ↗
57. A Riemannian Framework for Tensor Computing10.1007/s11263-005-3222-z ↗
58. Souza, V.L.F., Oliveira, A.L.I., and Sabourin, R. (2018, January 22–25). A Writer-Independent Approach for Offline Signature Verification using Deep Convolutional Neural Networks Features. Proceedings of the 2018 7th Brazilian Conference on Intelligent Systems (BRACIS), Sao Paulo, Brazil.10.1109/BRACIS.2018.00044 ↗
59. Kumar, A., and Bhatia, K. (2023). Offline Handwritten Signature Verification Using Decision Tree. Cyber Technologies and Emerging Sciences, Springer.10.1007/978-981-19-2538-2_30 ↗
60. Geometry-Aware Similarity Learning on SPD Manifolds for Visual Recognition10.1109/TCSVT.2017.2729660 ↗
61. SPD Manifold Deep Metric Learning for Image Set Classification10.1109/TNNLS.2022.3216811 ↗
62. Sra, S. (2012, January 3–6). A new metric on the manifold of kernel matrices with application to matrix geometric means. Proceedings of the Advances in Neural Information Processing Systems (NIPS), Lake Tahoe, NV, USA.
63. Wang, Z., and Vemuri, B.C. (July, January 27). An affine invariant tensor dissimilarity measure and its applications to tensor-valued image segmentation. Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Washington, DC, USA.
64. Faraki, M., Harandi, M.T., and Porikli, F. (2015, January 7–12). More about VLAD: A leap from Euclidean to Riemannian manifolds. Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA.10.1109/CVPR.2015.7299129 ↗
65. Aggregating Local Image Descriptors into Compact Codes10.1109/TPAMI.2011.235 ↗
66. Pedestrian Detection via Classification on Riemannian Manifolds10.1109/TPAMI.2008.75 ↗
67. Pennec, X., Sommer, S., and Fletcher, T. (2020). 3—Manifold-valued image processing with SPD matrices. Riemannian Geometric Statistics in Medical Image Analysis, Academic Press.10.1016/B978-0-12-814725-2.00008-X ↗
68. Offline signature verification and identification using distance statistics10.1142/S0218001404003630 ↗
69. Off-line signature verification based on grey level information using texture features10.1016/j.patcog.2010.07.028 ↗
70. MCYT baseline corpus: A bimodal biometric database10.1049/ip-vis:20031078 ↗
71. Pal, S., Alaei, A., Pal, U., and Blumenstein, M. (2016, January 11–14). Performance of an Off-Line Signature Verification Method Based on Texture Features on a Large Indic-Script Signature Dataset. Proceedings of the 2016 12th IAPR Workshop on Document Analysis Systems (DAS), Santorini, Greece.10.1109/DAS.2016.48 ↗
72. A Comprehensive Study of Sparse Representation Techniques for Offline Signature Verification10.1109/TBIOM.2019.2897802 ↗
73. Additive logistic regression: A statistical view of boosting (with discussion and a rejoinder by the authors)10.1214/aos/1016218223 ↗
74. Sleeman, D., and Edwards, P. (1992). Induction of One-Level Decision Trees. Machine Learning Proceedings 1992, Morgan Kaufmann.
75. Offline signature verification and quality characterization using poset-oriented grid features10.1016/j.patcog.2016.01.009 ↗
76. An introduction to ROC analysis10.1016/j.patrec.2005.10.010 ↗
77. Combining graph edit distance and triplet networks for offline signature verification10.1016/j.patrec.2019.06.024 ↗
78. Writer-independent off-line signature verification using surroundedness feature10.1016/j.patrec.2011.10.009 ↗
79. Offline signature verification using a region based deep metric learning network10.1016/j.patcog.2021.108009 ↗
80. Zhu, Y., Lai, S., Li, Z., and Jin, L. (2020, January 8–10). Point-to-Set Similarity Based Deep Metric Learning for Offline Signature Verification. Proceedings of the 2020 17th International Conference on Frontiers in Handwriting Recognition (ICFHR), Dortmund, Germany.10.1109/ICFHR2020.2020.00059 ↗
81. Deep Multitask Metric Learning for Offline Signature Verification10.1016/j.patrec.2016.05.023 ↗
82. One-Class Writer-Independent Offline Signature Verification Using Feature Dissimilarity Thresholding10.1109/TIFS.2016.2521611 ↗
83. Learning discriminative representations by a Canonical Correlation Analysis-based Siamese Network for offline signature verification10.1016/j.engappai.2024.109640 ↗