journal article·2022-03-02Open access

Face Recognition Based on Deep Learning and FPGA for Ethnicity Identification

Ahmed Jawad A. AlBdairi, Zhu Xiao, Ahmed Alkhayyat, Amjad J. Humaidi, Mohammed A. Fadhel, Bahaa Hussein Taher, Laith Alzubaidi, José Santamaría, Omran Al-Shamma

Applied Sciences· Volume 12· Issue 5

Abstract

In the last decade, there has been a surge of interest in addressing complex Computer Vision (CV) problems in the field of face recognition (FR). In particular, one of the most difficult ones is based on the accurate determination of the ethnicity of mankind. In this regard, a new classification method using Machine Learning (ML) tools is proposed in this paper. Specifically, a new Deep Learning (DL) approach based on a Deep Convolutional Neural Network (DCNN) model is developed, which outperforms a reliable determination of the ethnicity of people based on their facial features. However, it is necessary to make use of specialized high-performance computing (HPC) hardware to build a workable DCNN-based FR system due to the low computation power given by the current central processing units (CPUs). Recently, the latter approach has increased the efficiency of the network in terms of power usage and execution time. Then, the usage of field-programmable gate arrays (FPGAs) was considered in this work. The performance of the new DCNN-based FR method using FPGA was compared against that using graphics processing units (GPUs). The experimental results considered an image dataset composed of 3141 photographs of citizens from three distinct countries. To our knowledge, this is the first image collection gathered specifically to address the ethnicity identification problem. Additionally, the ethnicity dataset was made publicly available as a novel contribution to this work. Finally, the experimental results proved the high performance provided by the proposed DCNN model using FPGAs, achieving an accuracy level of 96.9 percent and an F1 score of 94.6 percent while using a reasonable amount of energy and hardware resources.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Face recognition and analysis · Video Surveillance and Tracking Methods · Face and Expression Recognition

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

College of Computer Science and Electronic Engineering, Hunan University, Changsha 410082, China

Department of Computer Science, University of Babylon, Babylon 51001, Iraq

College of Technical Engineering, The Islamic University, Najaf 54001, Iraq

Control and Systems Engineering Department, University of Technology-Iraq, Baghdad 00964, Iraq

College of Computer Science and Information Technology, University of Sumer, Rifai 64005, Iraq

School of Mechanical, Medical and Process Engineering, Queensland University of Technology, Brisbane, QLD 4000, Australia

Department of Computer Science, University of Jaén, 23071 Jaén, Spain

AlNidhal Campus, University of Information Technology & Communications, Baghdad 10001, Iraq

References (46)

Show source-provided references
1. Gallo, P., Pongnumkul, S., and Nguyen, U.Q. (2018, January 12–15). BlockSee: Blockchain for IoT video surveillance in smart cities. Proceedings of the 2018 IEEE International Conference on Environment and Electrical Engineering and 2018 IEEE Industrial and Commercial Power Systems Europe (EEEIC/I&CPS Europe), Palermo, Italy.10.1109/EEEIC.2018.8493895 ↗
2. Statistical accuracy analysis of different detecting algorithms for surveillance system in smart city
3. SVAS: Surveillance Video Analysis System10.1016/j.eswa.2017.07.051 ↗
4. Darabant, A.S., Borza, D., and Danescu, R. (2021). Recognizing Human Races through Machine Learning—A Multi-Network, Multi-Features Study. Mathematics, 9.10.3390/math9020195 ↗
5. Toward Abnormal Trajectory and Event Detection in Video Surveillance10.1109/TCSVT.2016.2589859 ↗
6. Vo, T., Nguyen, T., and Le, T. (2018). Race Recognition Using Deep Convolutional Neural Networks. Symmetry, 10.10.3390/sym10110564 ↗
7. 3D geometry-based face recognition in presence of eye and mouth occlusions10.1007/s12008-019-00582-7 ↗
8. Khan, A., and Marwa, M. (2019, January 7–11). Considering race a problem of transfer learning. Proceedings of the IEEE Winter Applications of Computer VisionWorkshops, Waikoloa Village, NI, USA.10.1109/WACVW.2019.00022 ↗
9. Analysis of morphous characteristics of facial reconstruction and the five organs in Chinese north five national minorities crowd
10. Learning Race from Face: A Survey10.1109/TPAMI.2014.2321570 ↗
11. Alzubaidi, L., Fadhel, M.A., Al-Shamma, O., Zhang, J., Santamaría, J., and Duan, Y. (2021). Robust application of new deep learning tools: An experimental study in medical imaging. Multimedia Tools Appl., 1–29.10.1007/s11042-021-10942-9 ↗
12. Deepening into the suitability of using pre-trained models of ImageNet against a lightweight convolutional neural network in medical imaging: An experimental study10.7717/peerj-cs.715 ↗
13. Alzubaidi, L., Fadhel, M., Al-Shamma, O., Zhang, J., Santamaría, J., Duan, Y., and Oleiwi, S. (2020). Towards a Better Understanding of Transfer Learning for Medical Imaging: A Case Study. Appl. Sci., 10.10.3390/app10134523 ↗
14. Nasser, A.R., Hasan, A.M., Humaidi, A.J., Alkhayyat, A., Alzubaidi, L., Fadhel, M.A., Santamaría, J., and Duan, Y. (2021). IoT and Cloud Computing in Health-Care: A New Wearable Device and Cloud-Based Deep Learning Algorithm for Monitoring of Diabetes. Electronics, 10.10.3390/electronics10212719 ↗
15. Multi-channel spectrograms for speech processing applications using deep learning methods10.1007/s10044-020-00921-5 ↗
16. An Introduction to Deep Learning in Natural Language Processing: Models, Techniques, and Tools10.1016/j.neucom.2021.05.103 ↗
17. Alzubaidi, L., Al-Amidie, M., Al-Asadi, A., Humaidi, A.J., Al-Shamma, O., Fadhel, M.A., Zhang, J., Santamaría, J., and Duan, Y. (2021). Novel Transfer Learning Approach for Medical Imaging with Limited Labeled Data. Cancers, 13.10.3390/cancers13071590 ↗
18. Comparison of hybrid convolutional neural networks models for diabetic foot ulcer classification
19. Machine and deep learning for sport-specific movement recognition: A systematic review of model development and performance10.1080/02640414.2018.1521769 ↗
20. Simonyan, K., and Zisserman, A. (2014). Very deep convolutional networks for large-scale image recognition. arXiv.
21. Al-Shamma, O., Fadhel, M.A., Hameed, R.A., Alzubaidi, L., and Zhang, J. (2018). Boosting convolutional neural networks performance based on FPGA accelerator. International Conference on Intelligent Systems Design and Applications, Springer.10.1007/978-3-030-16657-1_47 ↗
22. Frasser, C.F., de Benito, C., Skibinsky-Gitlin, E.S., Canals, V., Font-Rosselló, J., Roca, M., Ballester, P.J., and Rosselló, J.L. (2021). Using Stochastic Computing for Virtual Screening Acceleration. Electronics, 10.10.3390/electronics10232981 ↗
23. Coe, J., and Atay, M. (2021). Evaluating Impact of Race in Facial Recognition across Machine Learning and Deep Learning Algorithms. Computers, 10.10.3390/computers10090113 ↗
24. An efficient three-dimensional face recognition system based random forest and geodesic curves10.1016/j.comgeo.2021.101758 ↗
25. Klare, B., and Jain, A.K. (2010, January 27–29). On a taxonomy of facial features. Proceedings of the 2010 Fourth IEEE International Conference on Biometrics: Theory, Applications and Systems (BTAS), Washington, DC, USA.10.1109/BTAS.2010.5634533 ↗
26. Deep neural network for halftone image classification based on sparse auto-encoder10.1016/j.engappai.2016.01.032 ↗
27. HCP: A Flexible CNN Framework for Multi-Label Image Classification10.1109/TPAMI.2015.2491929 ↗
28. Optimal marker set assessment for motion capture of 3D mimic facial movements10.1016/j.jbiomech.2019.06.012 ↗
29. Regression-based methods for face alignment: A survey
30. Li, X., Lai, S., and Qian, X. (2021). DBCFace: Towards Pure Convolutional Neural Network Face Detection. IEEE Trans. Circuits Syst. Video Technol.10.1109/TCSVT.2021.3082635 ↗
31. Li, H., Lin, Z., Shen, X., Brandt, J., and Hua, G. (2015, January 7–12). A convolutional neural network cascade for face detection. Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA.10.1109/CVPR.2015.7299170 ↗
32. Face alignment using a deep neural network with local feature learning and recurrent regression10.1016/j.eswa.2017.07.018 ↗
33. Smile detection in the wild with deep convolutional neural networks10.1007/s00138-016-0817-z ↗
34. Ahmed, E., Jones, M.J., and Marks, T.K. (2015, January 7–12). An improved deep learning architecture for person re-identification. Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA.10.1109/CVPR.2015.7299016 ↗
35. Marvasti-Zadeh, S.M., Cheng, L., Ghanei-Yakhdan, H., and Kasaei, S. (2021). Deep learning for visual tracking: A comprehensive survey. IEEE Trans. Intell. Transp. Syst.10.1109/TITS.2020.3046478 ↗
36. Human activity recognition with smartphone sensors using deep learning neural networks10.1016/j.eswa.2016.04.032 ↗
37. Deep Feature Transfer Learning in Combination with Traditional Features Predicts Survival among Patients with Lung Adenocarcinoma10.18383/j.tom.2016.00211 ↗
38. Long, J., Shelhamer, E., and Darrell, T. (2015, January 7–12). Fully convolutional networks for semantic segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.10.1109/CVPR.2015.7298965 ↗
39. Deep convolutional neural networks for computer-aided detection: CNN architectures, dataset characteristics and transfer learning10.1109/TMI.2016.2528162 ↗
40. Efficient Processing of Deep Neural Networks: A Tutorial and Survey10.1109/JPROC.2017.2761740 ↗
41. Véstias, M.P. (2019). A Survey of Convolutional Neural Networks on Edge with Reconfigurable Computing. Algorithms, 12.10.3390/a12080154 ↗
42. Umuroglu, Y., Fraser, N.J., Gambardella, G., Blott, M., Leong, P., Jahre, M., and Vissers, K. (2017, January 22–24). Finn: A framework for fast, scalable binarized neural network inference. Proceedings of the 2017 ACM/SIGDA International Symposium on Field-Programmable Gate Arrays, New York, NY, USA.10.1145/3020078.3021744 ↗
43. Seng, K.P., Lee, P.J., and Ang, L.M. (2021). Embedded Intelligence on FPGA: Survey, Applications and Challenges. Electronics, 10.10.3390/electronics10080895 ↗
44. Review of deep learning: Concepts, CNN architectures, challenges, applications, future directions
45. He, K., Wang, Y., and Hopcroft, J. (2016). A powerful generative model using random weights for the deep image representation. arXiv.
46. Identifying Ethnics of People through Face Recognition: A Deep CNN Approach