Privacy-Friendly Datasets of Synthetic Fingerprints for Evaluation of Biometric Algorithms
Source abstract
Abstract
The datasets of synthetic biometric samples are created having in mind two major objectives: bypassing privacy concerns and compensating for missing sample variability in datasets of real biometric samples. If the purpose of generating samples is the evaluation of biometric systems, the foremost challenge is to generate so-called mated impressions—different fingerprints of the same finger. Note that for fingerprints, the finger’s identity is given by the co-location of minutiae points. The other challenge is to ensure the realism of generated samples. We solve both challenges by reconstructing fingerprints from pseudo-random minutiae making use of the pix2pix network. For controlling the identity of mated impressions, we derive the locations and orientations of minutiae from randomly created non-realistic synthetic fingerprints and slightly modify them in an identity-preserving way. Our previously trained pix2pix models reconstruct fingerprint images from minutiae maps, ensuring that the realistic appearance is transferred from training to synthetic samples. The main contribution of this work lies in creating and making public two synthetic fingerprint datasets of 500 virtual subjects with 8 fingers each and 10 impressions per finger, totaling 40,000 samples in each dataset. Our synthetic datasets are designed to possess characteristics of real biometric datasets. Thus, we believe they can be applied for the privacy-friendly testing of fingerprint recognition systems. In our evaluation, we use NFIQ2 for approving the visual quality and Verifinger SDK for measuring the reconstruction success.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Biometric Identification and Security · Face recognition and analysis · Digital Media Forensic Detection
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Computer Science, Otto von Guericke University, 39106 Magdeburg, Germany
Funding
Deutsche Forschungsgemeinschaft (DFG)
References (57)
Show source-provided references
1. Carlini, N., Chien, S., Nasr, M., Song, S., Terzis, A., and Tramer, F. (2022, January 22–26). Membership Inference Attacks From First Principles. Proceedings of the IEEE Symposium on Security and Privacy (SP), San Francisco, CA, USA.10.1109/SP46214.2022.9833649 ↗
2. Generation of Privacy-friendly Datasets of Latent Fingerprint Images using generative adversarial networks
3. Bahmani, K., Plesh, R., Johnson, P., Schuckers, S., and Swyka, T. (2021, January 19–22). High Fidelity Fingerprint Generation: Quality, Uniqueness, And Privacy. Proceedings of the IEEE International Conference on Image Processing (ICIP’21), Anchorage, AK, USA.10.1109/ICIP42928.2021.9506386 ↗
4. Karras, T., Aila, T., Laine, S., and Lehtinen, J. (May, January 30). Progressive Growing of GANs for Improved Quality, Stability, and Variation. Proceedings of the 6th International Conference on Learning Representations (ICLR’18), Vancouver, BC, Canada.
5. A Style-Based Generator Architecture for Generative Adversarial Networks10.1109/TPAMI.2020.2970919 ↗
6. Karras, T., Laine, S., Aittala, M., Hellsten, J., Lehtinen, J., and Aila, T. (2019). Analyzing and Improving the Image Quality of StyleGAN. arXiv.10.1109/CVPR42600.2020.00813 ↗
7. Makrushin, A., Mannam, V.S., and Dittmann, J. (2023, January 19–21). Data-Driven Fingerprint Reconstruction from Minutiae Based on Real and Synthetic Training Data. Proceedings of the 18th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications—Volume 4: VISAPP, SCITEPRESS, Lisbon, Portugal.10.5220/0011660800003417 ↗
8. Makrushin, A., Kauba, C., Kirchgasser, S., Seidlitz, S., Kraetzer, C., Uhl, A., and Dittmann, J. (2021, January 22–25). General Requirements on Synthetic Fingerprint Images for Biometric Authentication and Forensic Investigations. Proceedings of the ACM Workshop on Information Hiding and Multimedia Security (IH&MMSec’21), Virtual.10.1145/3437880.3460410 ↗
9. Models for fingerprint pattern formation10.1016/j.forsciint.2007.02.025 ↗
10. Modelling fingerprint ridge orientation using Legendre polynomials10.1016/j.patcog.2009.04.023 ↗
11. Zinoun, F. (2018). Can a Fingerprint be Modelled by a Differential Equation?. arXiv.
12. Zhao, Q., Jain, A.K., Paulter, N.G., and Taylor, M. (2012, January 23–27). Fingerprint image synthesis based on statistical feature models. Proceedings of the 2012 IEEE Fifth International Conference on Biometrics: Theory, Applications and Systems (BTAS), Arlington, VA, USA.10.1109/BTAS.2012.6374554 ↗
13. Cappelli, R., Maio, D., and Maltoni, D. (2002, January 11–15). Synthetic fingerprint-database generation. Proceedings of the 2002 International Conference on Pattern Recognition (ICPR), Quebec, QC, Canada.
14. Johnson, P., Hua, F., and Schuckers, S. (2013, January 23–28). Texture Modeling for Synthetic Fingerprint Generation. Proceedings of the 2013 IEEE Conference on Computer Vision and Pattern Recognition Workshops, Portland, OR, USA.10.1109/CVPRW.2013.30 ↗
15. Li, S.Z., and Jain, A. (2009). Encyclopedia of Biometrics, Springer.10.1007/978-3-642-27733-7 ↗
16. Ansari, A.H. (2011). Generation and Storage of Large Synthetic Fingerprint Database. [Master’s Thesis, Indian Institute of Science Bangalore].
17. PrintsGAN: Synthetic Fingerprint Generator
18. Ghahramani, Z., Welling, M., Cortes, C., Lawrence, N., and Weinberger, K. (2014, January 8–13). Generative Adversarial Nets. Proceedings of the Advances in Neural Information Processing Systems, Montreal, QC, Canada.
19. Odena, A., Olah, C., and Shlens, J. (2017, January 6–11). Conditional image synthesis with auxiliary classifier GANs. Proceedings of the International Conference on Machine Learning, PMLR, Sydney, Australia.
20. Radford, A., Metz, L., and Chintala, S. (2015). Unsupervised representation learning with deep convolutional generative adversarial networks. arXiv.
21. Karras, T., Aittala, M., Laine, S., Härkönen, E., Hellsten, J., Lehtinen, J., and Aila, T. (2021, January 6–14). Alias-Free generative adversarial networks. Proceedings of the NIPS, Online.
22. Mirza, M., and Osindero, S. (2014). Conditional Generative Adversarial Nets. arXiv.
23. Zhu, J.Y., Park, T., Isola, P., and Efros, A.A. (2017, January 22–29). Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks. Proceedings of the 2017 IEEE International Conference on Computer Vision (ICCV), Venice, Italy.10.1109/ICCV.2017.244 ↗
24. Isola, P., Zhu, J.Y., Zhou, T., and Efros, A.A. (2017, January 21–26). Image-to-Image Translation with Conditional Adversarial Networks. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.10.1109/CVPR.2017.632 ↗
25. Bouzaglo, R., and Keller, Y. (2022). Synthesis and Reconstruction of Fingerprints using Generative Adversarial Networks. arXiv.
26. Minaee, S., and Abdolrashidi, A. (2018). Finger-GAN: Generating Realistic Fingerprint Images Using Connectivity Imposed GAN. arXiv.
27. Fingerprint Verification Competition 200610.1016/S0969-4765(07)70140-6 ↗
28. High resolution partial fingerprint alignment using pore–valley descriptors10.1016/j.patcog.2009.08.004 ↗
29. Guyon, I., Luxburg, U.V., Bengio, S., Wallach, H., Fergus, R., Vishwanathan, S., and Garnett, R. (2017, January 4–9). GANs Trained by a Two Time-Scale Update Rule Converge to a Local Nash Equilibrium. Proceedings of the Advances in Neural Information Processing Systems, Long Beach, CA, USA.
30. A Lightweight GAN Network for Large Scale Fingerprint Generation
31. Cao, K., and Jain, A. (2018, January 20–23). Fingerprint Synthesis: Evaluating Fingerprint Search at Scale. Proceedings of the 2018 International Conference on Biometrics (ICB), Gold Coast, Australia.10.1109/ICB2018.2018.00016 ↗
32. Gulrajani, I., Ahmed, F., Arjovsky, M., Dumoulin, V., and Courville, A.C. (2017, January 4–9). Improved Training of Wasserstein GANs. Proceedings of the Advances in Neural Information Processing Systems, Long Beach, CA, USA.
33. Mistry, V., Engelsma, J.J., and Jain, A.K. (October, January 28). Fingerprint Synthesis: Search with 100 Million Prints. Proceedings of the 2020 IEEE International Joint Conference on Biometrics (IJCB), Houston, TX, USA.10.1109/IJCB48548.2020.9304885 ↗
34. Wyzykowski, A.B.V., Segundo, M.P., and de Paula Lemes, R. (2020). Level Three Synthetic Fingerprint Generation. arXiv.
35. Hill, C.J. (2001). Risk of Masquerade Arising from the Storage of Biometrics. [Bachelor’s Thesis, Australian National University].
36. Fingerprint Image Reconstruction from Standard Templates10.1109/TPAMI.2007.1087 ↗
37. From Template to Image: Reconstructing Fingerprints from Minutiae Points10.1109/TPAMI.2007.1018 ↗
38. A nonlinear orientation model for global description of fingerprints10.1016/0031-3203(95)00154-9 ↗
39. Fingerprint Reconstruction: From Minutiae to Phase10.1109/TPAMI.2010.77 ↗
40. Learning Fingerprint Reconstruction: From Minutiae to Image10.1109/TIFS.2014.2363951 ↗
41. Watson, C.I. (2008). NIST Special Database 14. NIST Mated Fingerprint Card Pairs 2 (MFCP2), NIST.
42. Wijewardena, K.P., Grosz, S.A., Cao, K., and Jain, A.K. (2022). Fingerprint Template Invertibility: Minutiae vs. Deep Templates. arXiv.10.1109/TIFS.2022.3229587 ↗
43. Kim, H., Cui, X., Kim, M.G., and Nguyen, T.H.B. (2019, January 2–4). Reconstruction of Fingerprints from Minutiae Using Conditional Adversarial Networks. Proceedings of the IWDW’18, Chengdu, China.10.1007/978-3-030-11389-6_26 ↗
44. Makrushin, A., Mannam, V.S., Rao, B.N.M., and Dittmann, J. (2022, January 26–28). Data-driven Reconstruction of Fingerprints from Minutiae Maps. Proceedings of the IEEE 24th Int. Workshop on Multimedia Signal Processing (MMSP’22), Shanghai, China.10.1109/MMSP55362.2022.9949242 ↗
45. Wang, T.C., Liu, M.Y., Zhu, J.Y., Tao, A., Kautz, J., and Catanzaro, B. (2018, January 18–22). High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANs. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Salt Lake City, UT, USA.10.1109/CVPR.2018.00917 ↗
46. FVC2000 (2023, September 04). The First Fingerprint Verification Competition. Available online: http://bias.csr.unibo.it/fvc2000/databases.asp.
47. FVC2002 (2023, September 04). The Second Fingerprint Verification Competition. Available online: http://bias.csr.unibo.it/fvc2002/databases.asp.
48. FVC2004 (2023, September 04). The Third Fingerprint Verification Competition. Available online: http://bias.csr.unibo.it/fvc2004/databases.asp.
49. NIST (2023, September 04). NIST Fingerprint Image Quality (NFIQ) 2, Available online: https://www.nist.gov/services-resources/software/nfiq-2.
50. Neurotechnology (2023, September 04). VeriFinger SDK. Available online: https://www.neurotechnology.com/verifinger.html.
51. Neurotechnology (2023, September 04). Neurotechnology CrossMatch dataset. Available online: https://www.neurotechnology.com/download.html.
52. Ronneberger, O., Fischer, P., and Brox, T. (2015). U-Net: Convolutional Networks for Biomedical Image Segmentation. arXiv.10.1007/978-3-319-24574-4_28 ↗
53. Long, J., Shelhamer, E., and Darrell, T. (2014). Fully Convolutional Networks for Semantic Segmentation. arXiv.10.1109/CVPR.2015.7298965 ↗
54. Zhou, Y., and Berg, T.L. (2016). Learning Temporal Transformations From Time-Lapse Videos. arXiv.10.1007/978-3-319-46484-8_16 ↗
55. Wang, X., and Gupta, A. (2016). Generative Image Modeling using Style and Structure Adversarial Networks. arXiv.10.1007/978-3-319-46493-0_20 ↗
56. Neurotechnology (2023, September 04). Cross Match Verifier 300 Classic. Available online: https://www.neurotechnology.com/fingerprint-scanner-cross-match-verifier-300-classic.html.
57. Ulyanov, D., Vedaldi, A., and Lempitsky, V. (2016). Instance Normalization: The Missing Ingredient for Fast Stylization. arXiv.