A Multicomponent Face Verification and Identification System
Source abstract
Abstract
Face recognition technology is a biometric technology, which is based on the identification or verification of facial features. Automatic face recognition is an active research field in the context of computer vision and artificial intelligence (AI) that is fundamental for a variety of real-time applications. In this research, the design and implementation of a face verification and identification system of a flexible, modular, secure, and scalable architecture is proposed. The proposed system incorporates several and various types of system components: (i) portable capabilities (mobile application and mixed reality [MR] glasses), (ii) enhanced monitoring and visualization via a user-friendly Web-based user interface (UI), and (iii) information sharing via middleware to other external systems. The experiments showed that such interconnected and complementary system components were able to perform robust and real-time results related to face identification and verification. Furthermore, to identify a proper model of high accuracy, robustness, and performance speed for face identification and verification tasks, a comprehensive evaluation of multiple face recognition pre-trained models (FaceNet, ArcFace, Dlib, and MobileNetV2) on a curated version of the ID vs. Spot dataset was performed. Among the models used, FaceNet emerged as a preferable choice for real-time tasks due to its balance between accuracy and inference speed for both face identification and verification tasks achieving AUC of 0.99, Rank-1 of 91.8%, Rank-5 of 95.8%, FNR of 2% and FAR of 0.1%, accuracy of 98.6%, and inference speed of 52 ms.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Face and Expression Recognition
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Institute of Communication and Computer Systems (ICCS), 15773 Zografou, Greece
Funding
European Union’s Horizon Europe research and innovation programme
References (75)
Show source-provided references
1. (2025, February 14). Public-IvS. Available online: http://www.cbsr.ia.ac.cn/users/xiangyuzhu/projects/LBL/main.htm.
2. Kortli, Y., Jridi, M., Al Falou, A., and Atri, M. (2020). Face Recognition Systems: A Survey. Sensors, 20.10.3390/s20020342 ↗
3. A Review of Face Recognition Technology10.1109/ACCESS.2020.3011028 ↗
4. Samatas, G.G., and Papakostas, G.A. (2022). Biometrics: Going 3D. Sensors, 22.10.3390/s22176364 ↗
5. Recent development in face recognition10.1016/j.neucom.2019.08.110 ↗
6. The face is central to primate multicomponent signals10.1007/s10764-021-00260-0 ↗
7. Sharma, R., Sharma, V.K., and Singh, A. (2021, January 11–13). A Review Paper on Facial Recognition Techniques. Proceedings of the 2021 Fifth International Conference on I-SMAC (IoT in Social, Mobile, Analytics and Cloud) (I-SMAC), Palladam, India.10.1109/I-SMAC52330.2021.9640896 ↗
8. Sanchez-Moreno, A.S., Olivares-Mercado, J., Hernandez-Suarez, A., Toscano-Medina, K., Sanchez-Perez, G., and Benitez-Garcia, G. (2021). Efficient Face Recognition System for Operating in Unconstrained Environments. J. Imaging, 7.10.3390/jimaging7090161 ↗
9. Guérin, J., Gibaru, O., Thiery, S., and Nyiri, E. (2017). CNN features are also great at unsupervised classification. arXiv.10.5121/csit.2018.80308 ↗
10. Deep Learning for Computer Vision: A Brief Review10.1155/2018/7068349 ↗
11. Douklias, A., Karagiannidis, L., Misichroni, F., and Amditis, A. (2022). Design and Implementation of a UAV-Based Airborne Computing Platform for Computer Vision and Machine Learning Applications. Sensors, 22.10.3390/s22052049 ↗
12. Maltezos, E., Doulamis, A., and Ioannidis, C. (2017, January 6–8). Improving the visualisation of 3D textured models via shadow detection and removal. Proceedings of the 2017 9th International Conference on Virtual Worlds and Games for Serious Applications (VS-Games), Athens, Greece.10.1109/VS-GAMES.2017.8056589 ↗
13. Park, J., Yang, H., Roh, H.-J., Jung, W., and Jang, G.-J. (2022). Encoder-Weighted W-Net for Unsupervised Segmentation of Cervix Region in Colposcopy Images. Cancers, 14.10.3390/cancers14143400 ↗
14. Ratha, N.K., Patel, V.M., and Chellappa, R. (2021). Deep CNN Face Recognition: Looking at the Past and the Future. Deep Learning-Based Face Analytics, Springer International Publishing. Advances in Computer Vision and Pattern Recognition.10.1007/978-3-030-74697-1 ↗
15. Wang, W. (2021, January 28–29). The development of face recognition in accuracy and speed: A Review. Proceedings of the 2021 2nd International Conference on Computing and Data Science (CDS), Stanford, CA, USA.10.1109/CDS52072.2021.00020 ↗
16. Boutros, F., Damer, N., and Kuijper, A. (2022). QuantFace: Towards Lightweight Face Recognition by Synthetic Data Low-bit Quantization. arXiv.10.1109/ICPR56361.2022.9955645 ↗
17. Perez-Montes, F., Olivares-Mercado, J., Sanchez-Perez, G., Benitez-Garcia, G., Prudente-Tixteco, L., and Lopez-Garcia, O. (2023). Analysis of Real-Time Face-Verification Methods for Surveillance Applications. J. Imaging, 9.10.3390/jimaging9020021 ↗
18. Zhang, A., Lipton, Z.C., Li, M., and Smola, A.J. (2021). Dive into Deep Learning. arXiv.
19. Modified constrained learning algorithms incorporating additional functional constraints into neural networks10.1016/j.ins.2007.09.008 ↗
20. Sun, Y., Wang, X., and Tang, X. (2014, January 24–27). Deep Learning Face Representation from Predicting 10,000 Classes. Proceedings of the 2014 IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.10.1109/CVPR.2014.244 ↗
21. Sun, Y., Wang, X., and Tang, X. (2014). Deep Learning Face Representation by Joint Identification-Verification. arXiv.
22. Liu, J., Deng, Y., Bai, T., Wei, Z., and Huang, C. (2015). Targeting Ultimate Accuracy: Face Recognition via Deep Embedding. arXiv.
23. Schroff, F., Kalenichenko, D., and Philbin, J. (2015, January 7–12). FaceNet: A unified embedding for face recognition and clustering. Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA.10.1109/CVPR.2015.7298682 ↗
24. Parkhi, O.M., Vedaldi, A., and Zisserman, A. (2015, January 7–10). Deep Face Recognition. Proceedings of the British Machine Vision Conference 2015, Swansea, UK.10.5244/C.29.41 ↗
25. Wu, X., He, R., Sun, Z., and Tan, T. (2015). A Light CNN for Deep Face Representation with Noisy Labels. arXiv.
26. Zhong, Y., Chen, J., and Huang, B. (2017). Towards End-to-End Face Recognition through Alignment Learning. arXiv.10.1109/LSP.2017.2715076 ↗
27. Deep Coupled ResNet for Low-Resolution Face Recognition10.1109/LSP.2018.2810121 ↗
28. Nam, G., Choi, H., Cho, J., and Kim, I.-J. (2018). PSI-CNN: A Pyramid-Based Scale-Invariant CNN Architecture for Face Recognition Robust to Various Image Resolutions. Appl. Sci., 8.10.3390/app8091561 ↗
29. Deng, J., Guo, J., Xue, N., and Zafeiriou, S. (2019, January 15–20). ArcFace: Additive Angular Margin Loss for Deep Face Recognition. Proceedings of the 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA.10.1109/CVPR.2019.00482 ↗
30. Meng, Q., Zhao, S., Huang, Z., and Zhou, F. (2021, January 20–25). MagFace: A Universal Representation for Face Recognition and Quality Assessment. Proceedings of the 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Nashville, TN, USA.10.1109/CVPR46437.2021.01400 ↗
31. Ju, Y.-J., Lee, G.-H., Hong, J.-H., and Lee, S.-W. (2022, January 3–8). Complete Face Recovery GAN: Unsupervised Joint Face Rotation and De-Occlusion from a Single-View Image. Proceedings of the 2022 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), Waikoloa, HI, USA.10.1109/WACV51458.2022.00124 ↗
32. PocketNet: Extreme Lightweight Face Recognition Network Using Neural Architecture Search and Multistep Knowledge Distillation10.1109/ACCESS.2022.3170561 ↗
33. MobileFaceNets: Efficient CNNs for Accurate Real-Time Face Verification on Mobile Devices10.1007/978-3-319-97909-0_46 ↗
34. Tan, M., and Le, Q.V. (2019). EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks. arXiv.
35. Han, K., Wang, Y., Tian, Q., Guo, J., Xu, C., and Xu, C. (2020, January 13–19). GhostNet: More Features From Cheap Operations. Proceedings of the 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA.10.1109/CVPR42600.2020.00165 ↗
36. Hoo, S.C., Ibrahim, H., and Suandi, S.A. (2022). ConvFaceNeXt: Lightweight Networks for Face Recognition. Mathematics, 10.10.3390/math10193592 ↗
37. Kim, S., An, B.S., and Lee, E.C. (2023). Comparative Analysis of AI-Based Facial Identification and Expression Recognition Using Upper and Lower Facial Regions. Appl. Sci., 13.10.3390/app13106070 ↗
38. Adjabi, I., Ouahabi, A., Benzaoui, A., and Taleb-Ahmed, A. (2020). Past, Present, and Future of Face Recognition: A Review. Electronics, 9.10.20944/preprints202007.0479.v1 ↗
39. Merler, M., Ratha, N., Feris, R.S., and Smith, J.R. (2019). Diversity in Faces. arXiv.
40. Filntisis, P.P., Retsinas, G., Paraperas-Papantoniou, F., Katsamanis, A., Roussos, A., and Maragos, P. (2022). Visual Speech-Aware Perceptual 3D Facial Expression Reconstruction from Videos. arXiv.10.1109/CVPRW59228.2023.00609 ↗
41. Liu, Z., Luo, P., Wang, X., and Tang, X. (2015, January 7–13). Deep Learning Face Attributes in the Wild. Proceedings of the 2015 IEEE International Conference on Computer Vision (ICCV), Santiago, Chile.10.1109/ICCV.2015.425 ↗
42. Unlabeled Data Assistant: Improving Mask Robustness for Face Recognition10.1109/TIFS.2024.3354109 ↗
43. A Comprehensive Review of Face Recognition Techniques, Trends, and Challenges10.1109/ACCESS.2024.3424933 ↗
44. Huber, M., Luu, A.T., Terhörst, P., and Damer, N. (2024, January 3–8). Efficient Explainable Face Verification based on Similarity Score Argument Backpropagation. Proceedings of the 2024 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), Waikoloa, HI, USA.10.1109/WACV57701.2024.00467 ↗
45. (2025, February 14). AI Act|Shaping Europe’s Digital Future. Available online: https://digital-strategy.ec.europa.eu/en/policies/regulatory-framework-ai.
46. Anwar, A., and Raychowdhury, A. (2020). Masked Face Recognition for Secure Authentication. arXiv.
47. FaceNet recognition algorithm subject to multiple constraints: Assessment of the performance
48. Rexha, B., Shala, G., and Xhafa, V. (2018). Increasing Trustworthiness of Face Authentication in Mobile Devices by Modeling Gesture Behavior and Location Using Neural Networks. Future Internet, 10.10.3390/fi10020017 ↗
49. Lee, H., Park, S.-H., Yoo, J.-H., Jung, S.-H., and Huh, J.-H. (2020). Face Recognition at a Distance for a Stand-Alone Access Control System. Sensors, 20.10.3390/s20030785 ↗
50. Chillaron, M., Dunai, L., Fajarnes, G.P., and Lengua, I.L. (2015, January 9–12). Face detection and recognition application for Android. Proceedings of the IECON 2015—41st Annual Conference of the IEEE Industrial Electronics Society, Yokohama, Japan.10.1109/IECON.2015.7392581 ↗
51. Valenzuela, W., Soto, J.E., Zarkesh-Ha, P., and Figueroa, M. (2021). Face Recognition on a Smart Image Sensor Using Local Gradients. Sensors, 21.10.3390/s21092901 ↗
52. Talahua, J.S., Buele, J., Calvopiña, P., and Varela-Aldás, J. (2021). Facial Recognition System for People with and without Face Mask in Times of the COVID-19 Pandemic. Sustainability, 13.10.3390/su13126900 ↗
53. Liu, R., Liu, Y., Wang, Z., and Tian, H. (2022, January 8–9). Research on face recognition technology based on an improved LeNet-5 system. Proceedings of the 2022 International Seminar on Computer Science and Engineering Technology (SCSET), Indianapolis, IN, USA.10.1109/SCSET55041.2022.00036 ↗
54. Zhou, Y., Wu, N., Hu, B., Zhang, Y., Qiu, J., and Cai, W. (2022). Implementation and Performance of Face Recognition Payment System Securely Encrypted by SM4 Algorithm. Information, 13.10.3390/info13070316 ↗
55. Ríos-Sánchez, B., Costa-da-Silva, D., Martín-Yuste, N., and Sánchez-Ávila, C. (2019). Deep Learning for Facial Recognition on Single Sample per Person Scenarios with Varied Capturing Conditions. Appl. Sci., 9.10.3390/app9245474 ↗
56. Reddy, T.J., Ganesh, M.S., Kumar Reddy, M.H., Bhandhavya, C., and Jansi, R. (2024, January 4–6). Deep Learning-Powered Face Detection and Recognition for Challenging Environments. Proceedings of the 2024 2nd International Conference on Intelligent Data Communication Technologies and Internet of Things (IDCIoT), Bengaluru, India.10.1109/IDCIoT59759.2024.10467753 ↗
57. Durai, S., Sujithra, T., Satyam, B.V., Keshetty, S.N., Sagar, C.N.S., and Charan, A.S. (2024, January 10–12). Real Time Facial Recognition-Based Criminal Identification Using MTCNN. Proceedings of the 2024 2nd International Conference on Sustainable Computing and Smart Systems (ICSCSS), Coimbatore, India.10.1109/ICSCSS60660.2024.10624946 ↗
58. Živković, N., and Žarić, N. (2024, January 21–24). Development and implementation of a facial recognition intrusion detection system. Proceedings of the 2024 28th International Conference on Information Technology (IT), Zabljak, Montenegro.10.1109/IT61232.2024.10475779 ↗
59. Medvedev, I., Shadmand, F., Cruz, L., and Gonçalves, N. (2021). Towards Facial Biometrics for ID Document Validation in Mobile Devices. Appl. Sci., 11.10.3390/app11136134 ↗
60. Large-Scale Bisample Learning on ID Versus Spot Face Recognition10.1007/s11263-019-01162-8 ↗
61. (2022, January 26). Apache Kafka. Available online: https://kafka.apache.org/.
62. (2023, November 21). MaoCai. Pytorch_Face_Recognition. Python. 31 March 2022. Available online: https://github.com/QuasarLight/Pytorch_Face_Recognition.
63. Dlib-ml: A Machine Learning Toolkit
64. (2025, February 14). OpenCV—Open Computer Vision Library. Available online: https://opencv.org/.
65. (2025, July 07). dlib C++ Library. Available online: https://dlib.net/.
66. (2025, July 07). davisking GitHub. Davisking/Dlib-Models: Trained Model Files for Dlib Example Programs. Available online: https://github.com/davisking/dlib-models.
67. Sandler, M., Howard, A., Zhu, M., Zhmoginov, A., and Chen, L.-C. (2018, January 18–23). MobileNetV2: Inverted Residuals and Linear Bottlenecks. Proceedings of the 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00474 ↗
68. (2025, February 14). MobileNet v2|PyTorch. Available online: https://pytorch.org/hub/pytorch_vision_mobilenet_v2/.
69. Martindez-Diaz, Y., Luevano, L.S., Mendez-Vazquez, H., Nicolas-Diaz, M., Chang, L., and Gonzalez-Mendoza, M. (2019, January 27–28). ShuffleFaceNet: A Lightweight Face Architecture for Efficient and Highly-Accurate Face Recognition. Proceedings of the 2019 IEEE/CVF International Conference on Computer Vision Workshop (ICCVW), Seoul, Republic of Korea.10.1109/ICCVW.2019.00333 ↗
70. Cosine similarity measures for intuitionistic fuzzy sets and their applications10.1016/j.mcm.2010.07.022 ↗
71. Item-based top-N recommendation algorithms10.1145/963770.963776 ↗
72. Using AUC and accuracy in evaluating learning algorithms10.1109/TKDE.2005.50 ↗
73. Xu, X., Huang, Y., Shen, P., Li, S., Li, J., Huang, F., Li, Y., and Cui, Z. (2021, January 20–25). Consistent Instance False Positive Improves Fairness in Face Recognition. Proceedings of the 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Nashville, TN, USA.10.1109/CVPR46437.2021.00064 ↗
74. A Quantitative Study on the FaceNet System10.1007/978-981-99-4284-8_17 ↗
75. Akingbesote, D., Zhan, Y., Maskeliūnas, R., and Damaševičius, R. (2023). Improving Accuracy of Face Recognition in the Era of Mask-Wearing: An Evaluation of a Pareto-Optimized FaceNet Model with Data Preprocessing Techniques. Algorithms, 16.10.3390/a16060292 ↗