Deep Region of Interest and Feature Extraction Models for Palmprint Verification Using Convolutional Neural Networks Transfer Learning
Source abstract
Abstract
Palmprint verification is one of the most significant and popular approaches for personal authentication due to its high accuracy and efficiency. Using deep region of interest (ROI) and feature extraction models for palmprint verification, a novel approach is proposed where convolutional neural networks (CNNs) along with transfer learning are exploited. The extracted palmprint ROIs are fed to the final verification system, which is composed of two modules. These modules are (i) a pre-trained CNN architecture as a feature extractor and (ii) a machine learning classifier. In order to evaluate our proposed model, we computed the intersection over union (IoU) metric for ROI extraction along with accuracy, receiver operating characteristic (ROC) curves, and equal error rate (EER) for the verification task.The experiments demonstrated that the ROI extraction module could significantly find the appropriate palmprint ROIs, and the verification results were crucially precise. This was verified by different databases and classification methods employed in our proposed model. In comparison with other existing approaches, our model was competitive with the state-of-the-art approaches that rely on the representation of hand-crafted descriptors. We achieved a IoU score of 93% and EER of 0.0125 using a support vector machine (SVM) classifier for the contact-based Hong Kong Polytechnic University Palmprint (HKPU) database. It is notable that all codes are open-source and can be accessed online.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Biometric Identification and Security · Forensic and Genetic Research · Face recognition and analysis
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Electrical and Computer Engineering, University of Birjand, Birjand 971481151, Iran
Department of Information Engineering, Electronics and Telecommunications of the University of Rome “La Sapienza”, 00185 Rome, Italy
References (65)
Show source-provided references
1. Palma, D., Montessoro, P.L., Giordano, G., and Blanchini, F. (2017). Biometric Palmprint Verification: A Dynamical System Approach. IEEE Trans. Syst. Man Cybern. Syst.
2. Recent Advances in Biometric Recognition
3. Latha, Y.M., and Prasad, M.V. (2015). A Survey on Palmprint-Based Biometric Recognition System. Innovative Research in Attention Modeling and Computer Vision Applications, IGI Global.10.4018/978-1-4666-8723-3.ch012 ↗
4. A survey of palmprint recognition10.1016/j.patcog.2009.01.018 ↗
5. Meraoumia, A., Laimeche, L., Bendjenna, H., and Chitroub, S. (2016, January 22–23). Do we have to trust the deep learning methods for palmprints identification?. Proceedings of the Mediterranean Conference on Pattern Recognition and Artificial Intelligence, Tebessa, Algeria.10.1145/3038884.3038898 ↗
6. Discriminative and robust competitive code for palmprint recognition10.1109/TSMC.2016.2597291 ↗
7. Imagenet classification with deep convolutional neural networks
8. Simonyan, K., and Zisserman, A. (arXiv, 2014). Very deep convolutional networks for large-scale image recognition, arXiv.
9. He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27–30). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.10.1109/CVPR.2016.90 ↗
10. Imagenet large scale visual recognition challenge10.1007/s11263-015-0816-y ↗
11. Bhanu, B., and Kumar, A. (2017). Deep Learning for Biometrics, Springer.10.1007/978-3-319-61657-5 ↗
12. Deep learning for visual understanding: A review10.1016/j.neucom.2015.09.116 ↗
13. A survey on transfer learning10.1109/TKDE.2009.191 ↗
14. Online palmprint identification10.1109/TPAMI.2003.1227981 ↗
15. An automated palmprint recognition system10.1016/j.imavis.2005.01.002 ↗
16. Han, Y., Sun, Z., Wang, F., and Tan, T. (2007, January 18–22). Palmprint recognition under unconstrained scenes. Proceedings of the Asian Conference on Computer Vision, Tokyo, Japan.
17. Palmprint based recognition system using phase-difference information10.1016/j.future.2010.11.029 ↗
18. Touch-less palm print biometrics: Novel design and implementation10.1016/j.imavis.2008.06.010 ↗
19. An innovative contactless palm print and knuckle print recognition system10.1016/j.patrec.2010.05.021 ↗
20. Contactless palmprint and knuckle biometrics for mobile devices10.1007/s10044-011-0248-4 ↗
21. Doublet, J., Lepetit, O., and Revenu, M. (2006, January 16–20). Contact less hand recognition using shape and texture features. Proceedings of the 2006 8th International Conference on Signal Processing, Beijing, China.10.1109/ICOSP.2006.345881 ↗
22. Developing a contactless palmprint authentication system by introducing a novel ROI extraction method10.1016/j.imavis.2015.05.002 ↗
23. AAM-based palm segmentation in unrestricted backgrounds and various postures for palmprint recognition10.1016/j.patrec.2013.02.016 ↗
24. Ito, K., Sato, T., Aoyama, S., Sakai, S., Yusa, S., and Aoki, T. (2015, January 19–22). Palm region extraction for contactless palmprint recognition. Proceedings of the 2015 International Conference on Biometrics (ICB), Phuket, Thailand.10.1109/ICB.2015.7139058 ↗
25. New algorithm of extraction of palmprint region of interest (ROI)
26. A comparative study of palmprint recognition algorithms10.1145/2071389.2071391 ↗
27. Palmprint recognition across different devices10.3390/s120607938 ↗
28. Texture based features for robust palmprint recognition: A comparative study10.1186/s13635-015-0022-z ↗
29. Fei, L., Lu, G., Jia, W., Teng, S., and Zhang, D. (2018). Feature Extraction Methods for Palmprint Recognition: A Survey and Evaluation. IEEE Trans. Syst. Man Cybern. Syst.10.1109/TSMC.2018.2795609 ↗
30. Accuracy improvement in palmprint authentication system10.5815/ijigsp.2015.04.06 ↗
31. Competitive coding scheme for palmprint verification
32. Double-orientation code and nonlinear matching scheme for palmprint recognition10.1016/j.patcog.2015.08.001 ↗
33. Fragile bits in palmprint recognition10.1109/LSP.2012.2211589 ↗
34. Local line directional pattern for palmprint recognition10.1016/j.patcog.2015.08.025 ↗
35. Robust and efficient ridge-based palmprint matching10.1109/TPAMI.2011.237 ↗
36. Roux, V., Aoyama, S., Ito, K., and Aoki, T. (2014, January 23–28). Performance improvement of phase-based correspondence matching for palmprint recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, Columbus, OH, USA.10.1109/CVPRW.2014.16 ↗
37. A coarse to fine minutiae-based latent palmprint matching10.1109/TPAMI.2013.39 ↗
38. Hierarchical minutiae matching for fingerprint and palmprint identification10.1109/TIP.2013.2280187 ↗
39. Towards contactless palmprint authentication10.1049/iet-cvi.2010.0191 ↗
40. Personal identification using multibiometrics rank-level fusion10.1109/TSMCC.2010.2089516 ↗
41. Li, W., Zhang, L., Zhang, D., Lu, G., and Yan, J. (2010, January 13–18). Efficient joint 2D and 3D palmprint matching with alignment refinement. Proceedings of the 2010 IEEE Conference on Computer Vision and Pattern Recognition, San Francisco, CA, USA.10.1109/CVPR.2010.5540134 ↗
42. Zhang, D., Guo, Z., and Gong, Y. (2016). An online system of multispectral palmprint verification. Multispectral Biometrics, Springer.10.1007/978-3-319-22485-5 ↗
43. Half-orientation extraction of palmprint features10.1016/j.patrec.2015.10.003 ↗
44. A two-phase test sample sparse representation method for use with face recognition10.1109/TCSVT.2011.2138790 ↗
45. Locality preserving discriminant projections for face and palmprint recognition10.1016/j.neucom.2010.04.017 ↗
46. Histogram of oriented lines for palmprint recognition10.1109/TSMC.2013.2258010 ↗
47. Combining left and right palmprint images for more accurate personal identification10.1109/TIP.2014.2380171 ↗
48. Novel image fusion scheme based on dependency measure for robust multispectral palmprint recognition10.1016/j.patcog.2013.12.011 ↗
49. Multifeature-based high-resolution palmprint recognition10.1109/TPAMI.2010.164 ↗
50. Discriminative deep metric learning for face and kinship verification10.1109/TIP.2017.2717505 ↗
51. Hybrid deep learning for face verification10.1109/TPAMI.2015.2505293 ↗
52. Kumar, A., and Wang, K. (2016). Identifying Humans by Matching Their Left Palmprint with Right Palmprint Images Using Convolutional Neural Network, The Hong Kong Polytechnic University. DLPR Proceedings.
53. Dian, L., and Dongmei, S. (2016, January 6–10). Contactless palmprint recognition based on convolutional neural network. Proceedings of the 2016 IEEE 13th International Conference on Signal Processing (ICSP), Chengdu, China.10.1109/ICSP.2016.7878049 ↗
54. Svoboda, J., Masci, J., and Bronstein, M.M. (2016, January 4–8). Palmprint recognition via discriminative index learning. Proceedings of the 2016 23rd International Conference on Pattern Recognition (ICPR), Cancun, Mexico.10.1109/ICPR.2016.7900298 ↗
55. Minaee, S., and Wang, Y. (arXiv, 2016). Palmprint recognition using deep scattering convolutional network, arXiv.10.1109/ISCAS.2017.8050421 ↗
56. Jalali, A., Mallipeddi, R., and Lee, M. (2015, January 21–24). Deformation invariant and contactless palmprint recognition using convolutional neural network. Proceedings of the 3rd International Conference on Human-Agent Interaction, Kyungpook, Korea.10.1145/2814940.2814977 ↗
57. PCANet: A simple deep learning baseline for image classification?10.1109/TIP.2015.2475625 ↗
58. Chatfield, K., Simonyan, K., Vedaldi, A., and Zisserman, A. (arXiv, 2014). Return of the devil in the details: Delving deep into convolutional nets, arXiv.10.5244/C.28.6 ↗
59. Redmon, J., Divvala, S., Girshick, R., and Farhadi, A. (2016, January 27–30). You only look once: Unified, real-time object detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.10.1109/CVPR.2016.91 ↗
60. Kingma, D.P., and Ba, J. (arXiv, 2014). Adam: A method for stochastic optimization, arXiv.
61. LIBSVM: A library for support vector machines10.1145/1961189.1961199 ↗
62. (2018, May 13). 2D Contact-free HKPU. Available online: http://www4.comp.polyu.edu.hk/~csajaykr/myhome/database_request/3dhand/Hand3D.htm.
63. (2018, May 13). IITD Touchless Palmprint Database. Available online: http://www4.comp.polyu.edu.hk/~csajaykr/IITD/Database_Palm.htm.
64. TensorFlow: A System for Large-Scale Machine Learning
65. The pascal visual object classes (voc) challenge10.1007/s11263-009-0275-4 ↗