journal article·2025-07-31Open access

Deep Learning-Based Fingerprint–Vein Biometric Fusion: A Systematic Review with Empirical Evaluation

Sarah Almuwayziri, Abeer Al-Nafjan, Hessah Aljumah, Mashael Aldayel

Applied Sciences· Volume 15· Issue 15

Abstract

User authentication is crucial for safeguarding access to digital systems and services. Biometric authentication serves as a strong and user-friendly alternative to conventional security methods such as passwords and PINs, which are often susceptible to breaches. This study proposes a deep learning-based multimodal biometric system that combines fingerprint (FP) and finger vein (FV) modalities to improve accuracy and security. The system explores three fusion strategies: feature-level fusion (combining feature vectors from each modality), score-level fusion (integrating prediction scores from each modality), and a hybrid approach that leverages both feature and score information. The implementation involved five pretrained convolutional neural network (CNN) models: two unimodal (FP-only and FV-only) and three multimodal models corresponding to each fusion strategy. The models were assessed using the NUPT-FPV dataset, which consists of 33,600 images collected from 140 subjects with a dual-mode acquisition device in varied environmental conditions. The results indicate that the hybrid-level fusion with a dominant score weight (0.7 score, 0.3 feature) achieved the highest accuracy (99.79%) and the lowest equal error rate (EER = 0.0018), demonstrating superior robustness. Overall, the results demonstrate that integrating deep learning with multimodal fusion is highly effective for advancing scalable and accurate biometric authentication solutions suitable for real-world deployments.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Biometric Identification and Security · Face recognition and analysis · Forensic Fingerprint Detection Methods

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Computer Science Department, College of Computer and Information Sciences, Imam Mohammad Ibn Saud Islamic University, Riyadh 11432, Saudi Arabia

Information Technology Department, College of Computer and Information Sciences, King Saud University, Riyadh 11543, Saudi Arabia

Funding

Research, Development, and Innovation Authority (RDIA)—Kingdom of Saudi Arabia

References (53)

Show source-provided references
1. Alay, N., and Al-Baity, H.H. (2020). Deep Learning Approach for Multimodal Biometric Recognition System Based on Fusion of Iris, Face, and Finger Vein Traits. Sensors, 20.10.3390/s20195523 ↗
2. Face-voice based multimodal biometric authentication system via FaceNet and GMM10.7717/peerj-cs.1468 ↗
3. A Survey on Multi-biometric Fusion Approaches
4. Sengar, S.S., Hariharan, U., and Rajkumar, K. (2020, January 12–14). Multimodal Biometric Authentication System using Deep Learning Method. Proceedings of the 2020 International Conference on Emerging Smart Computing and Informatics (ESCI), Pune, India.10.1109/ESCI48226.2020.9167512 ↗
5. A Comprehensive Overview on Biometric Authentication Systems using Artificial Intelligence Techniques
6. A multimodal biometric system for personal verification based on different level fusion of iris and face traits
7. LVID: A Multimodal Biometrics Authentication System on Smartphones10.1109/TIFS.2019.2944058 ↗
8. Fusion Time Reduction of a Feature Level Based Multimodal Biometric Authentication System10.4018/IJSKD.2020010104 ↗
9. Multimodal biometrics of fingerprint and signature recognition using multi-level feature fusion and deep learning techniques
10. Multimodal Biometric Recognition System Using Face and Finger Vein Biometric Traits with Feature and Decision Level Fusion Techniques10.7763/IJCTE.2021.V13.1300 ↗
11. Synthesis of Palm Print in Feature Fusion Techniques for Multimodal Biometric Recognition System Online Signature10.36548/jiip.2021.2.005 ↗
12. Iris-Fingerprint multimodal biometric system based on optimal feature level fusion model10.3934/electreng.2021013 ↗
13. Vinothkanna, R., and Wahi, A. (2020). A multimodal biometric approach for the recognition of finger print, palm print and hand vein using fuzzy vault. Int. J. Biomed. Eng. Technol., 33.10.1504/IJBET.2020.107650 ↗
14. Kumar, T., Bhushan, S., and Jangra, S. (2021). An Improved Biometric Fusion System of Fingerprint and Face using Whale Optimization. Int. J. Adv. Comput. Sci. Appl., 12.10.14569/IJACSA.2021.0120176 ↗
15. An Artificial Intelligence Based Multimodal Biometric Recognition Using Fully Convolutional Residual Neural Network
16. Suchetha, N.V., and Sharmila Kumari, M. (2023). Texture Analytics for Accurate Person Recognition: A Multimodal Approach. Int. J. Adv. Comput. Sci. Appl., 14.10.14569/IJACSA.2023.0140433 ↗
17. Face, Fingerprint, and Signature based Multimodal Biometric System using Score Level and Decision Level Fusion Approaches10.1080/03772063.2023.2217784 ↗
18. Palm and Fingerprint Based Multimodal Biometric Technique10.35940/ijrte.F7328.038620 ↗
19. Fusion of Hand Biometrics for Border Control Involving Fingerprint and Finger Vein10.1109/ACCESS.2025.3538591 ↗
20. Deep cancelable multibiometric finger vein and fingerprint authentication with non-negative matrix factorization10.1109/ACCESS.2024.3450372 ↗
21. Finger Vein Recognition Based on Vision Transformer With Feature Decoupling for Online Payment Applications10.1109/ACCESS.2025.3552075 ↗
22. Devi, D.V.R., and Rao, K.N. (2020, January 2–4). Decision level fusion schemes for a Multimodal Biometric System using local and global wavelet features. Proceedings of the 2020 IEEE International Conference on Electronics, Computing and Communication Technologies (CONECCT), Bangalore, India.10.1109/CONECCT50063.2020.9198547 ↗
23. Multimodal score level fusion for recognition using face and palmprint10.1177/0020720920929662 ↗
24. Investigating of nodes and personal authentications utilizing multimodal biometrics for medical application of WBANs security10.1007/s11042-020-08926-2 ↗
25. Person Verification Based on Multimodal Biometric Recognition10.47836/pjst.30.1.09 ↗
26. Score-Level Fusion of 3D Face and 3D Ear for Multimodal Biometric Human Recognition10.1155/2022/3019194 ↗
27. Aung, H.M.L., Pluempitiwiriyawej, C., Hamamoto, K., and Wangsiripitak, S. (2022). Multimodal Biometrics Recognition Using a Deep Convolutional Neural Network with Transfer Learning in Surveillance Videos. Computation, 10.10.3390/computation10070127 ↗
28. Optimized gravitational search algorithm for feature fusion in a multimodal biometric system10.1016/j.rineng.2023.101572 ↗
29. Deep learning-powered multimodal biometric authentication: Integrating dynamic signatures and facial data for enhanced online security10.1007/s00521-024-09690-2 ↗
30. New Feature-level Algorithm for a Face-fingerprint Integral Multi-biometrics Identification System10.21928/uhdjst.v6n1y2022.pp12-20 ↗
31. Optimized hybrid SVM-RF multi-biometric framework for enhanced authentication using fingerprint, iris, and face recognition10.7717/peerj-cs.2699 ↗
32. A novel feature biometric fusion approach for iris, speech and signature10.7494/cmms.2020.2.0655 ↗
33. Multimodal Feature-Level Fusion for Biometrics Identification System on IoMT Platform10.1109/ACCESS.2018.2815540 ↗
34. Score-Level Multimodal Biometric Authentication of Humans Using Retina, Fingerprint, and Fingervein10.4018/IJAEC.2020070102 ↗
35. Haider, S.A., Ashraf, S., Larik, R.M., Husain, N., Muqeet, H.A., Humayun, U., Yahya, A., Arfeen, Z.A., and Khan, M.F. (2023). An Improved Multimodal Biometric Identification System Employing Score-Level Fuzzification of Finger Texture and Finger Vein Biometrics. Sensors, 23.10.3390/s23249706 ↗
36. Improved Finger Vein Recognition Using Generative Adversarial Network and Transfer Learning10.1166/jno.2024.3643 ↗
37. Sequence-wise multimodal biometric fingerprint and finger-vein recognition network (STMFPFV-Net)
38. Improved Unsupervised Deep Boltzmann Learning Approach for Accurate Hand Vein Recognition10.1109/ACCESS.2024.3358209 ↗
39. A hybrid fusion model of iris, palm vein and finger vein for multi-biometric recognition system10.1007/s11042-020-08914-6 ↗
40. Avanzato, R., Beritelli, F., and Serrano, S. (2024). Robust Biometric Verification Using Phonocardiogram Fingerprinting and a Multilayer-Perceptron-Based Classifier. Electronics, 13.10.3390/electronics13224377 ↗
41. Multimodal biometric authentication: A novel deep learning framework integrating ECG, fingerprint, and finger knuckle print for high-security applications10.1088/2631-8695/ad9aa0 ↗
42. Fusion of Multimodal Audio Data for Enhanced Speaker Identification Using Kolmogorov-Arnold Networks10.1109/ACCESS.2025.3569606 ↗
43. Banati, U., Prakash, V., Verma, R., and Srivastava, S. (2022). Soft Biometrics and Deep Learning: Detecting Facial Soft Biometrics Features Using Ocular and Forehead Region for Masked Face Images, NSIT: Netaji Subhas University of Technology.10.21203/rs.3.rs-1174842/v1 ↗
44. Bashar, K. (2018, January 7–10). ECG and EEG Based Multimodal Biometrics for Human Identification. Proceedings of the 2018 IEEE International Conference on Systems, Man, and Cybernetics (SMC), Miyazaki, Japan.10.1109/SMC.2018.00734 ↗
45. Robust Inner Knuckle Print Recognition System Using Robust Inner Knuckle Print Recognition System Using DenseNet201 and InceptionV3 Models DenseNet201 and InceptionV3 Models Robust Inner Knuckle Print Recognition System Using DenseNet201 and InceptionV3 Models
46. A Dataset and Benchmark for Multimodal Biometric Recognition Based on Fingerprint and Finger Vein10.1109/TIFS.2022.3175599 ↗
47. Multimodal biometric identification: Leveraging convolutional neural network (CNN) architectures and fusion techniques with fingerprint and finger vein data10.7717/peerj-cs.2440 ↗
48. NLNet: A narrow-channel lightweight network for finger multimodal recognition10.1016/j.dsp.2024.104517 ↗
49. Saini, K., and Devi, R. (2023). A systematic scoping review of the analysis of COVID-19 disease using chest X-ray images with deep learning models. J. Auton. Intell., 7.10.32629/jai.v7i2.928 ↗
50. Taresh, M.M., Zhu, N., Ali, T.A.A., Hameed, A.S., and Mutar, M.L. (2021). Transfer Learning to Detect COVID-19 Automatically from X-Ray Images Using Convolutional Neural Networks. Int. J. Biomed. Imaging.10.1101/2020.08.25.20182170 ↗
51. Shen, Y., Yang, X., Liu, X., Wan, J., and Xia, N. (2024). Robust Biometric Recognition via Information Bottleneck Multi-Modal Feature Fusion. Res. Sq., preprint.10.21203/rs.3.rs-5326504/v1 ↗
52. From Simple to Complex Scenes: Learning Robust Feature Representations for Accurate Human Parsing10.1109/TPAMI.2024.3366769 ↗
53. Wang, C., Zhang, Q., Wang, X., Zhou, L., Li, Q., Xia, Z., Ma, B., and Shi, Y.Q. (2025). Light-Field Image Multiple Reversible Robust Watermarking Against Geometric Attacks. IEEE Trans. Dependable Secur. Comput., 1–15.10.1109/TDSC.2025.3576223 ↗